FrontierPhysics, a new benchmark of 56 end-to-end research tasks written by 42 physicists from their own work, tested 22 AI models in 26 configurations and found that no configuration passed more than 46 of its 168 research attempts
The arXiv:2611.06910 paper, "FrontierPhysics: Evaluating Agents for End-to-End Physics Research," submitted on 4 Nov 2026 by Bingran You and 71 other authors, measured the number of successful rollouts for 22 models in 26 configurations on the FrontierPhysics benchmark. The paper states that no configuration passed more than 46 of its 168 rollouts.
Verified 2026-11-12
Track with InsiderWhy it matters
AI models know plenty of physics but still struggle to carry out real research reliably, so claims of AI doing science on its own remain ahead of the evidence.
More on Models
- AI models can now win gold at the International Mathematical Olympiad, yet Stanford's 2026 AI Index found they still fumble a task most children master early. Across ClockBench's 180 clock designs and 720 questions, the top model, GPT-5.4 High, read analog clocks correctly only 50.6% of the time, versus 90.1% for humans
- After briefly nearly closing in 2024, the performance gap between the best closed-weight and open-weight AI models widened again on the Arena leaderboard. As of March 2026, Stanford's 2026 AI Index finds the top closed model leads the top open model by 3.3%, up from a 0.5% lead in August 2024
- Stanford's 2026 AI Index tracks how AI models perform on GPQA Diamond, a set of PhD-level chemistry and physics questions designed to resist Google searches. Mean model accuracy on the benchmark reached 93% in 2025, compared with an expert human validator baseline of 81.2% -- AI models now beat PhD-level experts by 12 points on GPQA Diamond
The AI boom,with receipts.
6 sourced facts every weekday, plus the Weekly Brief, AI company deep dives and so much more. Free.
Free · No card · Unsubscribe anytime · See today's issue →
Join now and you start with 100 Receipts on The Receipts Ledger — your first step toward a free year of Insider or Pro. How it works →