90% of US working hours are spent on tasks not covered well by AI benchmarks
What happened
Mercor has mapped AI benchmarks onto 923 U.S. occupations, finding that only 208 jobs have tasks covered by at least five benchmark prompts and that 90% of American working hours involve tasks with little or no benchmark coverage. The map shows that AI research focuses on high‑wage, large labor markets, leaving many middle‑income knowledge jobs underrepresented. The study uses O*NET tasks and a logistic regression to estimate coverage probabilities, highlighting gaps in AI benchmark coverage across the economy.
Why it matters
The lack of benchmarks for most work means we cannot reliably assess AI models’ performance on everyday jobs, which could affect future workforce planning and AI policy.
Reality check
An automated, sceptical read of the sourceIncremental. The study expands existing benchmark coverage but does not introduce a new AI technology or paradigm.
Is this a big deal?
Get stories like this every morning
The day's AI news in plain English, in your inbox at 8:30 IST. Free.
More AI news
AI unlocks Gödel's notebooks, said to contain hundreds of proved theoremsIndustry news · 13 Nov 2026Gemini 4 Hydrogen and OrchestratorIndustry news · 12 Nov 2026Gemini 4 HydrogenIndustry news · 12 Nov 2026I'm making LLMs work on small and old devicesIndustry news · 12 Nov 2026United Airlines bans AI agents from booking flights on behalf of travelersIndustry news · 11 Nov 2026This page was collected from mercor.com and summarised automatically by AIPulsee's pipeline. See how it runs.