Stanford's 2026 AI Index cites a study that pitted Microsoft's AI Diagnostic Orchestrator, paired with OpenAI's o3 reasoning model, against 21 practicing physicians with five to twenty years of experience working unaided on diagnostically challenging New England Journal of Medicine cases. The AI system's accuracy reached 85.5%, versus about 20% for the unaided physicians
The Stanford HAI AI Index 2026 report cites a study where Microsoft's AI Diagnostic Orchestrator, paired with OpenAI's o3 reasoning model, was tested on challenging cases from the New England Journal of Medicine. The AI system achieved 85.5% accuracy. This was compared to approximately 20% accuracy among 21 practicing physicians with five to 20 years of clinical experience working under comparable conditions.
Verified 2026-09-28
Track with InsiderWhy it matters
On hard medical puzzles AI can outperform doctors working alone, though real clinics are messier than tests.
- Price
- $521.03
- 30D
- -2.88%
- AI share of revenue
- 11.2%
PRICES 15-MIN DELAYED · EODHD
More on Models
- AI models can now win gold at the International Mathematical Olympiad, yet Stanford's 2026 AI Index found they still fumble a task most children master early. Across ClockBench's 180 clock designs and 720 questions, the top model, GPT-5.4 High, read analog clocks correctly only 50.6% of the time, versus 90.1% for humans
- After briefly nearly closing in 2024, the performance gap between the best closed-weight and open-weight AI models widened again on the Arena leaderboard. As of March 2026, Stanford's 2026 AI Index finds the top closed model leads the top open model by 3.3%, up from a 0.5% lead in August 2024
- Stanford's 2026 AI Index tracks how AI models perform on GPQA Diamond, a set of PhD-level chemistry and physics questions designed to resist Google searches. Mean model accuracy on the benchmark reached 93% in 2025, compared with an expert human validator baseline of 81.2% -- AI models now beat PhD-level experts by 12 points on GPQA Diamond
The AI boom,with receipts.
6 sourced facts every weekday, plus the Weekly Brief, AI company deep dives and so much more. Free.
Free · No card · Unsubscribe anytime · See today's issue →
Join now and you start with 100 Receipts on The Receipts Ledger — your first step toward a free year of Insider or Pro. How it works →