Will GPT-5 perform better than o1 (not preview) at AIME 2024, Codeforces elo, GPQA, or the 2024 ioi?
Basic
10
Ṁ326Dec 2
91%
chance
1D
1W
1M
ALL
o1's scores are the ones mentioned here. https://openai.com/index/learning-to-reason-with-llms/
Resolves yes if OpenAI or a third party tester is able to get GPT-5 to achieve higher scores on any of these benchmarks without any kind of prompt engineering or agent scaffolding
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
I had a previous question that asked whether I would judge GPT-5 smarter than 01 that is sitting at 85% yes.
Personally I am unsure why people think this since it is heavily implied GPT-5 won't utilize the scaled test-time compute paradigm which was so key to o1's success. I would bet that GPT-5 will be unable to do this and that the goal is more so achieving near o1 performance more quickly and economically
Related questions
Related questions
Will GPT-5 come out before 2027?
98% chance
Will GPT-5 score higher than 1350 on the Lmsys Arena Leaderboard
95% chance
Will GPT-5 reach a 1000 rating on Codeforces?
96% chance
Will GPT-5 win Bronze or better at IMO 2025?
22% chance
Will training on o1/o3 traces improve GPT-5 performance on a broad set of tasks?
63% chance
Will I judge GPT-5 to be smarter than o1 (not preview) after both are released?
81% chance
Will GPT-5 have an estimated IQ higher than 101?
79% chance
Will GPT-5 ace exams?
76% chance
Will GPT-5 be able to get gold on the International Mathematical Olympiad?
23% chance
Will GPT-5 be more competent than me in my area of expertise?
44% chance