News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Many languages

Trained across dozens of languages. 295 models on EveryLLM so far.

Multilingual models are trained across dozens or hundreds of languages and can answer, translate and switch between them. Because the web is dominated by English, builders must sample other languages more heavily, collect new data and design tokenizers that do not split non-Latin scripts into too many pieces. Skills learned in one language often transfer to others, so a multilingual model can do things in Swahili that it mostly learned in English.

Coverage keeps widening

BLOOM (2022) covered 46 natural languages and 13 programming languages. Meta's Llama 3.1 (2024) officially supported eight languages, while Google's Gemma 3 (March 2025) claimed over 140 and Alibaba's Qwen3 (April 2025) 119 languages and dialects. Switzerland's Apertus (September 2025) was trained on text in more than 1,800 languages. Cohere's Aya project (2024) gathered instruction data in 101 languages with help from about 3,000 researchers worldwide.

Gaps that remain

Benchmarks show that quality still drops in languages with little online text, and translated test sets can hide cultural mistakes. The same sentence can need several times more tokens in Hindi, Tamil or Amharic than in English, which makes it slower and dearer to process. Tokenizers have improved: OpenAI's GPT-4o tokenizer (2024) sharply cut token counts for Indian scripts such as Gujarati, Telugu and Hindi.

Famous many languages models

Still to be written: GPT-4o.

Further reading

wavWhisper WorldWhisper OpenAI's open-source model for turning speech into text and translating it.General · Open weights · 2022 T5 🇺🇸 United StatesT5 Encoder-decoder language model family from Google AI using a text-to-text framework.General · Fully open · 2019 MT5 🇺🇸 United StatesMT5 A multilingual text-to-text transformer pretrained on 101 languagesGeneral · Open weights · 2020 NLLB-200 🇺🇸 United StatesNLLB-200 A research translation model covering 200 languages, built for low-resource ones.General · Conditional licence · 2022 Aya 101 WorldAya 101 A 13-billion-parameter multilingual model that follows instructions in 101 languagesGeneral · Open weights · 2024 imgDeepSeek-V4.1-Flash 🇨🇳 ChinaDeepSeek-V4.1-Flash Multimodal MoE model with efficient KV cache compressionMultimodal · Open weights imgNVLM 1.0 🇺🇸 United StatesNVLM 1.0 Open multimodal language models from NVIDIA for vision and language tasksMultimodal · Open weights · 2024 imgvidDiffusionGemma 🇺🇸 United StatesDiffusionGemma A multimodal Gemma 4 model that writes text by denoising blocks of tokens.Multimodal · Open weights imgDeepSeek-OCR WorldDeepSeek-OCR Optical character recognition model using visual compressionMultimodal · Open weights · 2025 IndicBART 🇮🇳 IndiaIndicBART Sequence-to-sequence model for Indic languagesRegional · Open weights · 2021 AlexaTM 20B 🇺🇸 United StatesAlexaTM 20B A 20-billion-parameter multilingual sequence-to-sequence model from Amazon's Alexa team.General · Research only · 2022

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.