What is Grok 4's performance on METR's task length evaluation?
6
Ṁ2512026
29%
0 to 1.5 Hours
37%
1.5 to 2 Hours
18%
2 to 2.5 Hours
11%
2.5 to 3 Hours
6%
More than 3 Hours
Resolves based on the METR's measurement of the duration of tasks that can complete with a 50% success rate.
https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/
Grok 4 Heavy does not count
This question is managed and resolved by Manifold.
Get
1,000and
3.00
Sort by:
Related questions
Related questions
Humanity’s Last Exam lists grok 4 at 45%+?
2% chance
Will Grok 4 Top the Chatbot Leaderboard?
41% chance
Open-source OpenAI model beats Grok 4 on LMArena?
6% chance
How well will Grok 4 do on Frontier Math?
-
What is Grok 4 Heavy's performance on METR's task length evaluation?
Will Grok 4 be listed on the Chatbot Leaderboard in July?
93% chance
Grok 4 before 2026?
99% chance
GPT-5 vs Grok-2+: who will be funnier?