Machine-Generated Optimism Is Worse Than the Human Kind

Confidence: hypothesis. The model-behavior research below is drawn from published AI-alignment literature, not firsthand deployment. The gating pattern is an argument I have not shipped at scale. Argue with it.

Ask a person under pressure to tell you a plan is feasible, and you'll usually catch the hedge in their voice, the qualifier they add, the body language of someone saying what the room wants to hear. Ask a language model the same question under the same pressure, and you get none of those tells. Instead you get a fluent, confident, well-formatted “yes,” often with citations attached. That's the part that should worry you more than the optimism itself: machine-generated optimism arrives with all the surface markers of rigor and none of the honest doubt a person under the same incentive would at least half-signal.

The clinical why

Every party in a clinical trial's feasibility exercise benefits from a feasible-looking answer: the team wants the program to advance, the CRO wants the award, the sites want the study. That structural optimism is old and well understood; the industry has named it, studied it, and built processes (imperfect ones) around catching it in a room full of people who've seen it before.