Epoch AI's FrontierMath Erdős benchmark tasks AI models with proving or disproving 68 significant unsolved Erdős problems in Lean, each within a fixed $300, 72-hour budget. Running five frontier models in August 2026, only one produced any verified solution: GPT-6 Astra solved 2 of 68 problems (3%) — every other model tested scored 0%
Epoch AI created the FrontierMath Erdős benchmark to rigorously measure AI math capabilities. It challenges AI models to prove or disprove 68 significant unsolved Erdős problems, formalized in Lean, within a $300, 72-hour budget per problem. In August 2026, Epoch AI tested five frontier models, and only GPT-6 Astra produced verified solutions, solving 2 of the 68 problems.
Verified 2026-09-16
Track with InsiderWhy it matters
AI is starting to crack real open maths problems, though success remains rare and limited to one model.
More on Models
- AI models can now win gold at the International Mathematical Olympiad, yet Stanford's 2026 AI Index found they still fumble a task most children master early. Across ClockBench's 180 clock designs and 720 questions, the top model, GPT-5.4 High, read analog clocks correctly only 50.6% of the time, versus 90.1% for humans
- After briefly nearly closing in 2024, the performance gap between the best closed-weight and open-weight AI models widened again on the Arena leaderboard. As of March 2026, Stanford's 2026 AI Index finds the top closed model leads the top open model by 3.3%, up from a 0.5% lead in August 2024
- Stanford's 2026 AI Index tracks how AI models perform on GPQA Diamond, a set of PhD-level chemistry and physics questions designed to resist Google searches. Mean model accuracy on the benchmark reached 93% in 2025, compared with an expert human validator baseline of 81.2% -- AI models now beat PhD-level experts by 12 points on GPQA Diamond
FREE · NO CARD
Facts like this, six days a week
The Daily Receipts on weekdays, The Weekly Brief on Saturday — six sourced facts a day by email, two more than the free site shows. Every one traced to the filing it came from. Free.
Get the free daily briefFree · No card · Unsubscribe anytime
Join now and you start with 100 Receipts on The Receipts Ledger — your first step toward a free year of Insider or Pro. How it works →
See today's issue →