What organization will have the highest ELO score in the LMSYS Org Chatbot Arena Leaderboard at the end of Dec, 2024?
➕
Plus
72
Ṁ28k
Jan 1
Alphabet launches Gemini Pro 1.5.
Anthropic releases Claude 3.
+5%
on
OpenAI releases GPT-4o
Anthropic releases Claude 3.5 Sonnet
Meta releases Llama 3.1 405B
xAI releases Grok 2
OpenAI releases o1-preview
50%
Alphabet (Google)
46%
OpenAI
1.5%
xAI

I'm referring to this Chatbot Arena Leaderboard.

I'm planning on resolving based on who has the highest ELO score. This is because ELO scores were all that existed when I created this question.

Related:

#AI
#️ Technology
#OpenAI
#LLMs
#Google
#Chatbot Arena Leaderboard
#ELO Ratings
Get
Ṁ1,000
and
S3.00
Sort by:

They changed the column name from "ELO Score" to "Arena Score".

View original context
bought Ṁ100 YES

Gemini is back on top:

bought Ṁ250 YES

The latest Gemini model has jumped to the top of the leaderboard!

Scott Alexander mentioned this question in Mantic Monday 9/16/24 on Astral Codex Ten.

What other dates should I add to the graph?

@HankyUSA To start:

May 13, 2024: OpenAI releases GPT-4o

June 20, 2024: Anthropic releases Claude 3.5 Sonnet

July 23, 2024: Meta releases Llama 3.1 405B

August 13, 2024: xAI releases Grok 2

@HankyUSA September 12: OpenAI releases o1-preview

They changed the column name from "ELO Score" to "Arena Score".

TIL about Chatbot arena 👍

Related questions

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules