MetraX Forecast Scorecard

2026-08-21 to 2026-09-10 · measured on 1,495,332 logged prediction moments · updated 2026-09-11

57.1%
MetraX forecasts within 1 minute of actual arrival
125s
average forecast error
+6.9 pts
accuracy added over reading the raw feed naively

Accuracy edge, day by day

0+5+10+15baseline parityAug 21: +4.5 ptsAug 22: +13.1 ptsAug 23: +15.4 ptsAug 24: +4.2 ptsAug 25: +3.9 ptsAug 26: +6.8 ptsAug 27: +6.8 ptsAug 28: +6.0 ptsAug 29: +11.4 ptsAug 30: +10.5 ptsAug 31: +5.0 ptsSep 1: +5.5 ptsSep 2: +6.1 ptsSep 3: +6.1 ptsSep 4: +5.5 ptsSep 5: +13.5 ptsSep 6: +13.1 ptsSep 7: +11.4 ptsSep 8: +5.5 ptsSep 9: +5.2 ptsSep 10: +2.9 ptsAug 21Sep 10

Each point is one service day: the share of MetraX forecasts landing within one displayed minute of the real arrival, minus the same day’s share for the naive baseline, measured on identical rows. Above the dashed line, MetraX beat simply carrying the feed’s last reading forward unchanged. The series begins the day the current model went live; a day the engine has not scored leaves a gap rather than being drawn through.

Head to head with the feed's own ETA

horizon outnMetra's native ETA within-1-minMetraX app within-1-min
[0,5) min13365899.4%99.0%
[5,15) min14433977.2%80.9%
[15,30) min2790541.0%46.6%
[30,60) min423823.9%27.2%

Same moments, same stops, paired rows only (series since Aug 21, 21 day(s)). The MetraX column replays the shipped predictor under its live anchor policy — when a train is minutes away, MetraX intentionally carries the feed's own number, so the columns converge at short horizons; the model's added value appears from 15 minutes out, where a rider is deciding when to leave. GPS anchoring is not included in this replay, so the MetraX column slightly understates the live app.

What each predictive element contributes

elementwithin-1-min lifterror change
Route history+7.5 pts−9.7%
Delay momentum+4.1 pts−15.6%
Signal freshness+0.2 pts−1.6%
Full blend (shipped)+6.9 pts−16.8%

Each element measured against the naive baseline on identical rows (paired), trained only on data prior to each scored day.

How this is measured

Every metric on this page is computed from MetraX's own logged observations replayed against realized arrivals — no hand-picked examples, no survivorship. "Within 1 minute" means the displayed arrival minute was at most one minute off. The shipped-model series begins 2026-08-21.