In a randomised trial, 16 experienced open-source developers believed AI tools had made them 20% faster. Measured against issues they finished without AI, they were 19% slower
METR conducted a randomized controlled trial in early 2025 to measure the impact of AI tools on the productivity of 16 experienced open-source developers. The study found that developers took 19% longer to complete issues when using AI tools compared to working without them. This contrasted with the developers' belief that AI had made them 20% faster.
Verified 2026-08-01
Track with InsiderWhy it matters
How fast AI feels and how fast it actually is can differ, so measured results matter.
More on Labour
- AI hiring intensity doesn't track the size of a country's AI industry. Stanford's 2026 AI Index, drawing on Lightcast's job-postings database across dozens of countries, found the 2025 leader for AI-skill job-posting share by a wide margin was Singapore, at 4.69% of all job postings — nearly double the 2.6% share in the United States
- Stanford's 2026 AI Index, citing Lightcast's job-postings database, found that even as employer demand shifted toward newer agentic-AI skills, mentions of generative AI skills specifically in US AI job postings still grew, from 2024 to 2025, by 111%
- The information sector — telecom, media, tech services — led US corporate AI hiring in 2025. Lightcast data cited in Stanford's 2026 AI Index found AI skills required in 13.2% of the sector's job postings, up from 7.8% in 2024
The AI boom,with receipts.
6 sourced facts every weekday, plus the Weekly Brief, AI company deep dives and so much more. Free.
Free · No card · Unsubscribe anytime · See today's issue →
Join now and you start with 100 Receipts on The Receipts Ledger — your first step toward a free year of Insider or Pro. How it works →