Back Back
Models6/day by emailPrimary
Epoch AI audited its FrontierMath benchmark after OpenAI flagged suspiciously high scores, and its 12 June 2026 v2 release corrected errors in 42% of the original problems, leaving a verified set of 338 problems across four tiers
Epoch AI, which developed the FrontierMath benchmark, released a major update on June 12, 2026. This update addressed errors in 42% of the original problems. The full FrontierMath dataset now consists of 338 problems, split into Tiers 1-3 (295 problems) and Tier 4 (43 problems).
Verified 2026-08-24
Track with InsiderWhy it matters
Benchmarks can contain errors too, so a score is only as good as the test behind it.
The screener · 78 companiesEvery layer of the AI chain, priced dailyHow this was verifiedEvery figure links to the filing it came from
More on Models
- AI models can now win gold at the International Mathematical Olympiad, yet Stanford's 2026 AI Index found they still fumble a task most children master early. Across ClockBench's 180 clock designs and 720 questions, the top model, GPT-5.4 High, read analog clocks correctly only 50.6% of the time, versus 90.1% for humans
- After briefly nearly closing in 2024, the performance gap between the best closed-weight and open-weight AI models widened again on the Arena leaderboard. As of March 2026, Stanford's 2026 AI Index finds the top closed model leads the top open model by 3.3%, up from a 0.5% lead in August 2024
- Stanford's 2026 AI Index tracks how AI models perform on GPQA Diamond, a set of PhD-level chemistry and physics questions designed to resist Google searches. Mean model accuracy on the benchmark reached 93% in 2025, compared with an expert human validator baseline of 81.2% -- AI models now beat PhD-level experts by 12 points on GPQA Diamond
The AI boom,with receipts.
6 sourced facts every weekday, plus the Weekly Brief, AI company deep dives and so much more. Free.
Free · No card · Unsubscribe anytime · See today's issue →
Join now and you start with 100 Receipts on The Receipts Ledger — your first step toward a free year of Insider or Pro. How it works →