News
ResearchOpenAI pens AI safety agreement with four firmsReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierOpenAI鈥檚 New Hacking Model Found Dozens Of Holes In Apple TechFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIResearchOpenAI pens AI safety agreement with four firmsReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierOpenAI鈥檚 New Hacking Model Found Dozens Of Holes In Apple TechFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAI
EveryLLM

Many languages

Trained across dozens of languages. 295 models on EveryLLM so far.

Multilingual models are trained across dozens or hundreds of languages and can answer, translate and switch between them. Because the web is dominated by English, builders must sample other languages more heavily, collect new data and design tokenizers that do not split non-Latin scripts into too many pieces. Skills learned in one language often transfer to others, so a multilingual model can do things in Swahili that it mostly learned in English.

Coverage keeps widening

BLOOM (2022) covered 46 natural languages and 13 programming languages. Meta's Llama 3.1 (2024) officially supported eight languages, while Google's Gemma 3 (March 2025) claimed over 140 and Alibaba's Qwen3 (April 2025) 119 languages and dialects. Switzerland's Apertus (September 2025) was trained on text in more than 1,800 languages. Cohere's Aya project (2024) gathered instruction data in 101 languages with help from about 3,000 researchers worldwide.

Gaps that remain

Benchmarks show that quality still drops in languages with little online text, and translated test sets can hide cultural mistakes. The same sentence can need several times more tokens in Hindi, Tamil or Amharic than in English, which makes it slower and dearer to process. Tokenizers have improved: OpenAI's GPT-4o tokenizer (2024) sharply cut token counts for Indian scripts such as Gujarati, Telugu and Hindi.

Famous many languages models

Still to be written: GPT-4o.

Further reading

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.