Epoch AI compared how OpenAI's and Anthropic's flagship models handle very long prompts, and found GPT-5.6 Terra and Sol slow down quadratically as context grows while Claude Sonnet 5 and Opus 5 stay almost linear -- the marginal latency to process the next 10,000 tokens for GPT-5.6 Terra rose from 0.071 seconds at a 100,000-token prompt to 1.66 seconds at a 10-million-token prompt
Epoch AI measured time to first token for OpenAI's GPT-5.6 Terra and Sol and Anthropic's Claude Sonnet 5 and Opus 5 as prompts grew longer. For GPT-5.6 Terra, the extra latency to process another 10,000 tokens rose from 0.071 seconds at a 100,000-token prompt to 1.66 seconds at a 10-million-token prompt. Epoch found the GPT models scaled quadratically while the Claude models stayed close to linear.
Verified 2026-09-11
Track with InsiderWhy it matters
How a model slows down with long inputs affects cost and speed, so design choices matter beyond test scores.
More on Models
- AI models can now win gold at the International Mathematical Olympiad, yet Stanford's 2026 AI Index found they still fumble a task most children master early. Across ClockBench's 180 clock designs and 720 questions, the top model, GPT-5.4 High, read analog clocks correctly only 50.6% of the time, versus 90.1% for humans
- After briefly nearly closing in 2024, the performance gap between the best closed-weight and open-weight AI models widened again on the Arena leaderboard. As of March 2026, Stanford's 2026 AI Index finds the top closed model leads the top open model by 3.3%, up from a 0.5% lead in August 2024
- Stanford's 2026 AI Index tracks how AI models perform on GPQA Diamond, a set of PhD-level chemistry and physics questions designed to resist Google searches. Mean model accuracy on the benchmark reached 93% in 2025, compared with an expert human validator baseline of 81.2% -- AI models now beat PhD-level experts by 12 points on GPQA Diamond
FREE · NO CARD
Facts like this, six days a week
The Daily Receipts on weekdays, The Weekly Brief on Saturday — six sourced facts a day by email, two more than the free site shows. Every one traced to the filing it came from. Free.
Get the free daily briefFree · No card · Unsubscribe anytime
Join now and you start with 100 Receipts on The Receipts Ledger — your first step toward a free year of Insider or Pro. How it works →
See today's issue →