News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Many languages

Trained across dozens of languages. 295 models on EveryLLM so far.

Multilingual models are trained across dozens or hundreds of languages and can answer, translate and switch between them. Because the web is dominated by English, builders must sample other languages more heavily, collect new data and design tokenizers that do not split non-Latin scripts into too many pieces. Skills learned in one language often transfer to others, so a multilingual model can do things in Swahili that it mostly learned in English.

Coverage keeps widening

BLOOM (2022) covered 46 natural languages and 13 programming languages. Meta's Llama 3.1 (2024) officially supported eight languages, while Google's Gemma 3 (March 2025) claimed over 140 and Alibaba's Qwen3 (April 2025) 119 languages and dialects. Switzerland's Apertus (September 2025) was trained on text in more than 1,800 languages. Cohere's Aya project (2024) gathered instruction data in 101 languages with help from about 3,000 researchers worldwide.

Gaps that remain

Benchmarks show that quality still drops in languages with little online text, and translated test sets can hide cultural mistakes. The same sentence can need several times more tokens in Hindi, Tamil or Amharic than in English, which makes it slower and dearer to process. Tokenizers have improved: OpenAI's GPT-4o tokenizer (2024) sharply cut token counts for Indian scripts such as Gujarati, Telugu and Hindi.

Famous many languages models

Still to be written: GPT-4o.

Further reading

wavMamba WorldMamba Efficient sequence modelling architecture using state spacesResearch · Open weights GPT-2 🇺🇸 United StatesGPT-2 OpenAI's 2019 text model that predicts the next word in a sequenceGeneral · Open weights · 2019 T5 🇺🇸 United StatesT5 Encoder-decoder language model family from Google AI using a text-to-text framework.General · Fully open · 2019 NLLB-200 🇺🇸 United StatesNLLB-200 A research translation model covering 200 languages, built for low-resource ones.General · Conditional licence · 2022 ULMFiT WorldULMFiT Transfer learning method for NLP text classification tasksResearch · Open weights · 2018 IndicBART 🇮🇳 IndiaIndicBART Sequence-to-sequence model for Indic languagesRegional · Open weights · 2021 DeepSeekMoE 🇨🇳 ChinaDeepSeekMoE Mixture-of-experts language model architecture by DeepSeek AIGeneral · Open weights · 2024 AlexaTM 20B 🇺🇸 United StatesAlexaTM 20B A 20-billion-parameter multilingual sequence-to-sequence model from Amazon's Alexa team.General · Research only · 2022 LLaDA WorldLLaDA An 8-billion parameter diffusion language modelGeneral · Open weights · 2025 imgCogVLM 🇨🇳 ChinaCogVLM Open-source visual language model with deep feature fusionMultimodal · Open weights · 2023 PanGu-Sigma 🇨🇳 ChinaPanGu-Sigma Trillion-parameter sparse language model for Chinese NLP tasksGeneral · Research only · 2023 ERNIE 3.0 🇨🇳 ChinaERNIE 3.0 Knowledge-enhanced pre-training model for language tasksGeneral · Research only · 2021 Gemini Diffusion 🇺🇸 United StatesGemini Diffusion Experimental text diffusion model from Google DeepMindGeneral · Research only OPT 🇺🇸 United StatesOPT Meta AI's family of open decoder-only language models from 125M to 175B parametersGeneral · Conditional licence · 2022 S1 🇺🇸 United StatesS1 A reasoning model using test-time scaling and budget forcingReasoning · Fully open · 2025 RecurrentGemma 🇺🇸 United StatesRecurrentGemma Open language models using Google's Griffin recurrent-plus-attention architectureGeneral · Open weights · 2024 Switch Transformer WorldSwitch Transformer A sparse mixture-of-experts language model scaling to a trillion parameters.Research · Research only · 2021

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.