Sundog · Augury

Do the gamblers beat the bureau?

Every day, thousands of dollars trade on tomorrow's high temperature in a dozen cities. Weather forecasting has a mature, publicly funded model stack — physics ensembles, statistical blends, the works. So here is a fair question: does the betting crowd's price carry any weather information the models miss? We scored the market against the model stack at matched information cutoffs, over three and a half years. It does — and the surprise is which forecaster turns out redundant.

The edge is in the final hours

Market forecast skill minus the National Blend of Models, by hours before the daily high. Lower is a bigger market advantage. Pooled over 7 cities, 2023–2026.

models even with the market market advantage → −12h −7h −2h small 4× larger long lead (day-3 territory) final hours

The market wins by a hair at long lead and roughly four times as much in the final hours — exactly where "it is already 88° at 2pm" bounds the day's high in a way the morning model run cannot. The crossover is the finding, not the average.

The augur reads tomorrow off the price. At the margin, the augur beats the bureau — but only where the bureau has stopped looking.

A town kept two weather-tellers. One was the Bureau, which each dawn nailed a careful notice to the well and did not change it. The other was the Market — a knot of traders by the well who re-shouted their odds every hour as the day wore on. At sunrise the two agreed almost exactly, for the Market mostly read the Bureau's notice aloud. But by mid-afternoon, with the heat already in the air and the notice hours stale, the traders knew something the dawn notice never could: today was already what it was. The Bureau was not wrong. It had simply stopped speaking while the Market kept listening. A parable, not a proof. The chart above is the real measurement.

The question, made fair

Prediction markets like Kalshi settle each city's daily-high contract on the National Weather Service's official climate report. So the market is not competing to measure the temperature — it competes to forecast it, against the same models everyone else has. The honest way to ask "does the crowd know more?" is to freeze the clock at a given minute and compare, at that instant, the market's implied odds against the freshest model guidance available at the very same minute. Snapshot both at 6am; snapshot both at 2pm. Anything less measures staleness, not skill.

We did that at every hour across the run-up to each day's high, in seven cities, from February 2023 through June 2026 — roughly 3,300 city-days. Ground truth is the settling climate report; scoring is done at exactly the temperature thresholds the market trades, so nobody gets a home-field metric.

The pantheon, and the one that folds

A single "market beats one model" result is weak — a lossy echo of that model produces it by luck. The real test puts the whole forecaster pantheon in one regression and asks which members are non-redundant: whose information survives once everyone else's is already accounted for. We ran the market against a physics ensemble (the GEFS), the operational statistical blend (the National Blend of Models), and a second independent model (the ECMWF).

Who is still in the room?

Each forecaster's marginal contribution with all others present (encompassing coefficient, 95% interval). Above zero = carries information no one else has.

0 (redundant) market — 0.70 ECMWF (deterministic) — 0.61 NBM (blend) — 0.37 GEFS (physics ensemble) — screened out →
the aggregate (market) a model, still non-redundant redundant / screened out

The minimal set of forecasters that survives is { National Blend, ECMWF, market }. The one member that folds is the raw physics ensemble — because the National Blend already post-processes exactly that kind of physics, so the raw ensemble adds nothing on top of it. When the whole model stack is in the room, it is a model that proves redundant, not the market.

Market and model, at opposite ends of the day

Splitting the same test by lead time sharpens it. The market is non-redundant at both ends but strongest in the final hours — its advantage is real-time observation the stale model cycle cannot carry. The ECMWF is the mirror image: it earns its place at long lead, where genuine model skill separates the forecasters, and fades in the final hours where the market's live reading takes over. The two non-blend members of the set carry their information at opposite ends of the horizon. That is an information-access result, not a curiosity: each forecaster wins exactly where it has access the others lack.

What this is and is not

Why it is not obvious

The efficient guess is that the market is just a fast mirror of the models — arbitrage bots reprice within seconds of every model cycle, so the price should be a lossy shadow of the best public model, minus fees. That guess is mostly right, and it is exactly why the residual matters: after the models are fully accounted for, a non-zero, horizon-shaped signal remains. Richard Roll noticed the same shape forty years ago in orange-juice futures, which predicted errors in the government's Florida temperature forecasts. The market was reading the weather off the price. Here we can say where: at the margin, and in the final hours.

Sources & further reading

A Sundog evidence page. Real data, real ground truth, honest fences. Not investment advice.