Skip to content
writing

Publish the Weights: Make Optimism a Number You Can Discount

A private calibration adjustment fixes the next forecast. A published one fixes the next submission.

GovernanceEvaluationHypothesisLast tended · 2026-07-27
A private calibration adjustment fixes the next forecast. A published one fixes the next submission.
A private calibration adjustment fixes the next forecast. A published one fixes the next submission.

Confidence: hypothesis. The transparency practice below is drawn from published incident-review and forecasting-calibration literature, not firsthand deployment. The internal-publication discipline is an argument I have not shipped at scale. Argue with it.

Every team that tracks forecast accuracy eventually learns the same uncomfortable fact: some of their inputs are systematically optimistic. A site's self-reported enrollment capacity, a sales team's pipeline estimate, a vendor's delivery date: the same source, missing in the same direction, forecast after forecast. The rare team that notices this quietly discounts that source in the next model. The much rarer team writes the discount down where the person who submitted the optimistic number can see it.

That second move, publishing the weight and not just applying it, is the difference between a calibration practice that improves the next forecast and one that also improves the next submission.

Here's why the private version fails quietly. A planning team notices, over several cycles, that one vendor's delivery estimates run about 30% optimistic. They start applying a 0.7x haircut in their internal model. The forecast gets better. The vendor's next estimate does not. The vendor never saw the correction, has no reason to believe their estimating process needs fixing, and will submit the same kind of number next quarter. The team has built a permanent patch around a problem instead of fixing the problem, and the patch has to be maintained forever, quietly, by whoever remembers it exists.


This pattern is one piece of a longer treatment. The full essay is issue 3 of Stage × AI, a series walking the entire clinical-trial lifecycle stage by stage — what each stage really does, where AI helps, where it must not go, and one buildable pattern per stage:

full essay
Feasibility: The Forecast Everyone Wants to Believe

Evidence in, evidence out. Corrections welcome.