News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Text

Reads and writes text. 471 models on EveryLLM so far.

Text is the base modality of every language model: it reads a prompt and writes a reply, token by token. A tokenizer first splits text into tokens, which are whole words, pieces of words or single characters; in English a token is roughly three-quarters of a word. Everything else a model does, from code to reasoning to calling tools, is ultimately expressed as text that it reads or writes.

Tokens and context

Most models use byte-pair encoding, which builds a vocabulary of frequent character sequences. Vocabularies have grown from about 50,000 tokens in GPT-2 to around 200,000 in GPT-4o and 256,000 in Gemma. The context window is how many tokens the model can consider at once: GPT-3 handled 2,048 in 2020, while Gemini 1.5 Pro offered one million in 2024. Languages in non-Latin scripts often need more tokens for the same meaning.

What text-only still means

Many models remain text-only, especially smaller ones and older families such as GPT-3, Llama 2 and BERT, and text still carries most business uses: drafting, summarising, pulling fields out of documents, translation and search. Text-only models are cheaper to train and serve, and easier to evaluate, since their inputs and outputs can be checked and compared directly.

Famous text models

Further reading

imgDeepSeek-OCR WorldDeepSeek-OCR Optical character recognition model using visual compressionMultimodal · Open weights · 2025 Zamba2 🇺🇸 United StatesZamba2 Hybrid Mamba2-transformer language model suite by ZyphraGeneral · Open weights · 2024 Poro 🇫🇮 FinlandPoro Open 34B parameter model for Finnish, English and codeGeneral · Fully open · 2024 Grok-1 🇺🇸 United StatesGrok-1 xAI's 314 billion parameter open-weights mixture-of-experts base modelGeneral · Open weights · 2024 Gemini 2.5 Flash 🇺🇸 United StatesGemini 2.5 Flash A hybrid reasoning model from Google with adjustable thinking effortGeneral · API only · 2025 T-Pro 2.0 🇷🇺 RussiaT-Pro 2.0 Russian-tuned reasoning model based on Qwen 3Reasoning · Open weights Sarvam-105B 🇮🇳 IndiaSarvam-105B Open-weight MoE model for Indian languages and reasoningGeneral · Open weights imgwavvidReka Core 🇸🇬 SingaporeReka Core Multimodal language model by RekaMultimodal · API only · 2024 imgvidfnKimi K2.5 🇨🇳 ChinaKimi K2.5 Open-source multimodal agentic model with vision and reasoning.Multimodal · Open weights fnLlama 3.3 70B 🇺🇸 United StatesLlama 3.3 70B A text-only 70B instruction-tuned model from Meta's Llama 3 line.General · Conditional licence Hunyuan-Large 🇨🇳 ChinaHunyuan-Large Open-source mixture of experts model with 389 billion parametersGeneral · Open weights · 2024 Param-1 🇮🇳 IndiaParam-1 Bilingual and multilingual language models from India.General · Conditional licence imgSalamandra 🇪🇸 SpainSalamandra Open multilingual language models for European languagesGeneral · Open weights · 2025 RETRO WorldRETRO A retrieval-enhanced transformer that conditions on chunks from a huge document database.Research · Research only · 2021 Falcon Mamba 7B 🇦🇪 United Arab EmiratesFalcon Mamba 7B A 7-billion parameter language model using the Mamba architecture.General · Open weights · 2024 fnMiniMax-M2 🇨🇳 ChinaMiniMax-M2 Open-source MoE model for coding and agentsCode · Open weights fnNemotron 3 Nano 🇺🇸 United StatesNemotron 3 Nano NVIDIA's 30B hybrid Mamba-Transformer MoE model for reasoning and agentsGeneral · Conditional licence · 2025 AfriBERTa WorldAfriBERTa Multilingual encoder model for eleven African languagesEncoder · Open weights · 2021 imgvidfnKimi K3 🇨🇳 ChinaKimi K3 Open-weight multimodal agentic model with 2.8T parametersGeneral · Open weights · 2026 Airavata 🇮🇳 IndiaAiravata Instruction-tuned large language model for HindiRegional · Open weights · 2024 PaLM 2 🇺🇸 United StatesPaLM 2 Google's multilingual Transformer language model in four sizes, from on-device to largestGeneral · API only · 2023 GPT-SW3 🇸🇪 SwedenGPT-SW3 Generative language model for Nordic languagesGeneral · Research only · 2023 Sarvam-Translate 🇮🇳 IndiaSarvam-Translate Document-level translation model for 22 Indian languages.Domain · Fully open imgwavvidQwen2.5-Omni 🇨🇳 ChinaQwen2.5-Omni End-to-end multimodal model for real-time speech and video chat.Multimodal · Open weights · 2025 fnToolformer 🇺🇸 United StatesToolformer A language model that learns on its own when to call external tools through APIs.Research · Research only · 2023 ModernBERT 🇺🇸 United States and 1 moreModernBERT A modernised encoder model for retrieval and classification tasks.Encoder · Open weights · 2024 Viking 🇫🇮 FinlandViking Open source language model for Nordic languages and codeGeneral · Fully open · 2023 imgfnLeanstral 1.5 🇫🇷 FranceLeanstral 1.5 An open code agent model built for the Lean 4 proof assistantCode · Open weights Granite 3.0 🇺🇸 United StatesGranite 3.0 IBM's third-generation open enterprise language models, from 2B to 8B parametersGeneral · Open weights · 2024 Aya 101 WorldAya 101 A 13-billion-parameter multilingual model that follows instructions in 101 languagesGeneral · Open weights · 2024 Falcon-7B 🇦🇪 United Arab EmiratesFalcon-7B Open 7-billion parameter decoder model by TIIGeneral · Open weights · 2023 imgAmazon Nova 🇺🇸 United StatesAmazon Nova Amazon's family of foundation models on AWS BedrockGeneral · API only · 2024 fnNorth Mini Code 🇺🇸 United StatesNorth Mini Code A 30B sparse mixture-of-experts model for code and terminal agent workCode · Conditional licence fnGranite 4.2 🇺🇸 United StatesGranite 4.2 IBM's open reasoning language model family, released August 2026Reasoning · Open weights · 2026 Nemotron-4-Mini-Hindi-4B-Instr 🇺🇸 United StatesNemotron-4-Mini-Hindi-4B-Instruct A small Hindi-focused chat model from NVIDIA, tuned for Indian-context answersSmall · Open weights · 2024 imgfnAmazon Nova Premier 🇺🇸 United StatesAmazon Nova Premier Amazon's largest Nova model for complex tasks and model distillationGeneral · API only Galactica 🇺🇸 United StatesGalactica A language model trained on scientific text for research tasksDomain · Conditional licence · 2022 fnGranite 4.0 🇺🇸 United StatesGranite 4.0 IBM's hybrid Mamba/transformer language models for enterprise workGeneral · Open weights · 2025 imgfnMistral Large 3 🇫🇷 FranceMistral Large 3 A 675B-parameter open-weight mixture-of-experts multimodal model from Mistral AIGeneral · Open weights Apple Foundation Models 🇺🇸 United StatesApple Foundation Models Apple's on-device and server language models behind Apple IntelligenceGeneral · API only · 2024 imgMM1 WorldMM1 A family of multimodal language models up to 30B parameters, dense and MoE.Multimodal · Research only · 2024 imgApple Foundation Models 🇺🇸 United StatesApple Foundation Models Apple's 2025 on-device and server language models for Apple IntelligenceGeneral · API only · 2025 AlexaTM 20B 🇺🇸 United StatesAlexaTM 20B A 20-billion-parameter multilingual sequence-to-sequence model from Amazon's Alexa team.General · Research only · 2022 Orca 2 🇺🇸 United StatesOrca 2 A small LLaMA-2-based model trained on synthetic data to reason.Small · Conditional licence · 2023 Grok-1.5 🇺🇸 United StatesGrok-1.5 xAI's long-context Grok model with stronger reasoning and coding skillsGeneral · API only · 2024 imgwavfnGrok 4 🇺🇸 United StatesGrok 4 xAI's flagship reasoning model with native tool use and live searchGeneral · API only · 2025 imgGrok-2 🇺🇸 United StatesGrok-2 xAI's 2024 chat and reasoning model, with a smaller sibling, Grok-2 miniGeneral · Conditional licence · 2024 Command R WorldCommand R Cohere's model built for retrieval-augmented generation in productionGeneral · API only

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.