
Will a flagship (>60T training bytes) open-weights LLM from Meta which doesn't use a tokenizer be released in 2025?
Plus
7
Ṁ11742026
20%
chance
1D
1W
1M
ALL
Resolves YES if Meta releases weights of an LLM trained on at least 60T bytes of data (roughly equivalent to the 15T tokens used to train the Llama 3.1 models) in 2025 which does not use standard fixed-vocabulary tokenization.
A qualifying model must be released under a license roughly as permissive as Llama 3.1.
This market was spurred by recent research from Meta showing a proof-of-concept for a tokenizer-free LLM. A qualifying model from Meta does not need to use the patching technique from this paper as long as it's not using tokenization.
https://ai.meta.com/research/publications/byte-latent-transformer-patches-scale-better-than-tokens/
This question is managed and resolved by Manifold.
Get
1,000and
3.00
Related questions
Related questions
Will OpenAI release a new open-weight LM before September??
70% chance
OpenAI to release model weights by EOY?
83% chance
Will OpenAI release a tokenizer with more than 210000 tokens before 2026?
24% chance
Will the next major LLM by OpenAI use a new tokenizer?
77% chance
Will Meta ever deploy its best LLM without releasing its model weights up through AGI?
75% chance
Will anyone train a TokenFormer model at scale before 2026?
25% chance