SupnWeather
Edge Finder
/

SupnWeather

Engine · what production actually published, scored on settled outcomes — not a backtest

Loading…

What the tier is made of

four pillars, each measured on settled outcomes

Weekly station health

The tier's journey, the tripwire state, which watched stations are healing, and the hardest stations of the recent window.

October regime watch

Season-change evidence pack, refreshed weekly: H16 form and benched stations, per-station bias-correction load, the live gated record against the fraction trigger, and the paper dip book as a no-risk window into tail pricing.

Centre accuracy

How far off the published high is, and what a thermometer-only baseline would have missed.

Interval coverage

Every forecast promises a 50% window (p25–p75). Split history into what landed below, inside and above: each side should sit near 25%. Too much below means forecasts run warm; too much above, cold.

Bucket distribution quality

Polymarket settles on buckets (“exactly 28°”, “≥29°”), so this scores the full probability curve the trading layer bets with against a bland same-centre baseline. Zero mass on the truth must stay at 0%.

Analog-pool bake-off

The champion (12-member analog pool) against a 24-member shadow candidate, scored on the same settled outcomes before anything is promoted. Bucket shape is the engine's weakest pillar; a wider pool is the lever. The experiment writes this scoreboard the moment it starts.

Correction shadow scoreboard

The bias-correction layer's candidate product (corrected centre and band), scored on the same settled outcomes as the raw view. The site publishes the raw number; this is the evidence board for whether the correction earns its keep. Shadow MAE above raw MAE means the correction is hurting.

Learning & adaptation

Which correction method prices current editions, whose adjustments moved this week, how often the peak gate engages, and the warm-skew tripwire's daily walk. Every number re-derivable from the ledgers.

By lead time

How far ahead each forecast was issued. Physics makes error grow with distance; the job is keeping the band balanced at every distance, where long-lead bias likes to hide.

By prior lane

Every forecast blends an external daily-max estimate into the analog centre: the human-issued TAF TX, an NWP model, or nothing at long lead. Each lane is scored separately, with the prior's own error beside the analog's — the two numbers that say which side of the blend is sick. Last 14 days; “unrecorded” is the pre-prior era.

By code era

Every engine change gets its own fingerprint. Everything published under one version groups into one row: a before/after of every change, scored on real outcomes.

Stations

Same engine, different difficulty. Hardest rows are volatile airfields; sharpest are steady climates. Minimum 100 scored editions to rank.

Hardest

Sharpest

By weather regime

Clear skies, overcast and storms behave differently. The worst row is where new features pay most.

Bucket quality by store date

Distributions grouped by when they were written. After any engine change, the newest rows show the verdict while it is still news.

Probability calibration

Every bucket probability ever published, grouped by claimed size and checked against reality. Predicted 20%, happened 21% = calibrated. Gaps beyond ±5% mean confidence needs shrinking.

𝕏 @SupnPablo