News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Text

Reads and writes text. 471 models on EveryLLM so far.

Text is the base modality of every language model: it reads a prompt and writes a reply, token by token. A tokenizer first splits text into tokens, which are whole words, pieces of words or single characters; in English a token is roughly three-quarters of a word. Everything else a model does, from code to reasoning to calling tools, is ultimately expressed as text that it reads or writes.

Tokens and context

Most models use byte-pair encoding, which builds a vocabulary of frequent character sequences. Vocabularies have grown from about 50,000 tokens in GPT-2 to around 200,000 in GPT-4o and 256,000 in Gemma. The context window is how many tokens the model can consider at once: GPT-3 handled 2,048 in 2020, while Gemini 1.5 Pro offered one million in 2024. Languages in non-Latin scripts often need more tokens for the same meaning.

What text-only still means

Many models remain text-only, especially smaller ones and older families such as GPT-3, Llama 2 and BERT, and text still carries most business uses: drafting, summarising, pulling fields out of documents, translation and search. Text-only models are cheaper to train and serve, and easier to evaluate, since their inputs and outputs can be checked and compared directly.

Famous text models

Further reading

imgStep3 🇨🇳 ChinaStep3 Multimodal reasoning model with 321 billion parametersMultimodal · Open weights · 2025 fnSeed-OSS-36B 🇨🇳 ChinaSeed-OSS-36B Open-source 36B parameter language model with controllable reasoning.General · Open weights · 2025 imgvidIntern-S1 🇨🇳 ChinaIntern-S1 Open-source multimodal reasoning model for scienceReasoning · Open weights · 2025 MiMo-7B 🇨🇳 ChinaMiMo-7B Open reasoning model from Xiaomi for maths and codeReasoning · Open weights · 2025 Pangu Ultra 🇨🇳 ChinaPangu Ultra A 135-billion parameter dense language model trained on Ascend hardware.General · API only · 2025 imgvidfnInternVL3 🇨🇳 ChinaInternVL3 Open-source multimodal large language model seriesMultimodal · Open weights · 2025 imgfnUI-TARS 🇨🇳 ChinaUI-TARS Open-source multimodal agent for GUI tasksMultimodal · Open weights · 2025 MiMo-V2.5-Pro 🇨🇳 ChinaMiMo-V2.5-Pro Open-source MoE language model with 1M token contextGeneral · Open weights Baichuan-M2 🇨🇳 ChinaBaichuan-M2 Open-source medical reasoning model with 32 billion parameters.Reasoning · Open weights · 2025 Baichuan 2 🇨🇳 ChinaBaichuan 2 Open multilingual language models with 7B and 13B parameters.General · Open weights · 2023 imgwavvidMiMo-V2.6-Pro 🇨🇳 ChinaMiMo-V2.6-Pro Xiaomi’s 1T parameter multimodal model with 1M token contextMultimodal · Open weights fnGrok Code Fast 1 🇺🇸 United StatesGrok Code Fast 1 A fast, low-cost reasoning model built for agentic coding work.Reasoning · API only · 2026 imgNVLM 1.0 🇺🇸 United StatesNVLM 1.0 Open multimodal language models from NVIDIA for vision and language tasksMultimodal · Open weights · 2024 OpenELM 🇺🇸 United StatesOpenELM Apple's small open language models with a full training and inference releaseSmall · Open weights · 2024 imgfnDevstral 2 🇫🇷 FranceDevstral 2 Open-weight coding model family for software agentsCode · Open weights · 2026 K2-Think WorldK2-Think A 32 billion parameter open reasoning modelReasoning · Open weights · 2025 Fugaku-LLM 🇯🇵 JapanFugaku-LLM Japanese large language model trained on Fugaku supercomputerGeneral · Open weights · 2024 fnStep-3.5-Flash 🇨🇳 ChinaStep-3.5-Flash Open-source MoE model for reasoning and agentsGeneral · Open weights · 2026 Qwen2.5-72B 🇨🇳 ChinaQwen2.5-72B A 72-billion parameter open-weight language model from Alibaba Cloud.General · Open weights · 2024 MAI-1-preview 🇺🇸 United StatesMAI-1-preview Microsoft AI's first in-house foundation model, a mixture-of-experts system for everyday queriesGeneral · API only · 2025 Gemini Diffusion 🇺🇸 United StatesGemini Diffusion Experimental text diffusion model from Google DeepMindGeneral · Research only CodeGen 🇺🇸 United StatesCodeGen Open autoregressive language model for code generationCode · Open weights · 2022 EXAONE Deep 🇰🇷 South KoreaEXAONE Deep Reasoning-focused language models from LG AI ResearchReasoning · Open weights · 2025 DeepSeek Coder 🇨🇳 ChinaDeepSeek Coder Open-source code generation models from DeepSeekCode · Open weights · 2024 fnMistral Small 3 🇫🇷 FranceMistral Small 3 A 24B open-weight model tuned for low latency and local deploymentGeneral · Open weights · 2025 OPT 🇺🇸 United StatesOPT Meta AI's family of open decoder-only language models from 125M to 175B parametersGeneral · Conditional licence · 2022 Pragna-1B 🇮🇳 IndiaPragna-1B Small decoder model for Hindi, Bangla, Gujarati and EnglishSmall · Open weights fnTyphoon 🇹🇭 ThailandTyphoon Thai-focused large language model series by SCB 10XGeneral · Conditional licence · 2024 Flan-T5 🇺🇸 United StatesFlan-T5 Instruction-finetuned T5 checkpoints released by Google for zero-shot and few-shot workGeneral · Open weights · 2022 Llama 3 🇺🇸 United StatesLlama 3 Meta's open-weight language model family in 8B and 70B sizesGeneral · Conditional licence · 2024 imgvidNemotron 3.5 Super VL 🇺🇸 United StatesNemotron 3.5 Super VL NVIDIA's open-weight vision-language model with 120B parameters and 1M-token contextMultimodal · Conditional licence · 2026 Jamba2 Mini WorldJamba2 Mini A small open-weights SSM-Transformer model for enterprise workSmall · Open weights fnMinistral 3B and 8B 🇫🇷 FranceMinistral 3B and 8B Two small Mistral AI models built for on-device and edge computing.Small · API only · 2024 imgvidDiffusionGemma 🇺🇸 United StatesDiffusionGemma A multimodal Gemma 4 model that writes text by denoising blocks of tokens.Multimodal · Open weights Qwen2 🇨🇳 ChinaQwen2 Open-weight language model series from AlibabaGeneral · Open weights · 2024 Mamba-2 🇺🇸 United StatesMamba-2 A state-space model architecture for efficient language modellingResearch · Fully open · 2024 imgvidGLM-4.1V-Thinking 🇨🇳 ChinaGLM-4.1V-Thinking Open-source vision-language model with reasoning focusMultimodal · Open weights · 2025 Qwen2.5-Coder 🇨🇳 ChinaQwen2.5-Coder Open code-specialised language model series by Alibaba CloudCode · Open weights · 2024 Sailor 🇸🇬 SingaporeSailor Open multilingual language models for South-East AsiaGeneral · Open weights · 2024 imgwavvidGemini 2.5 Pro 🇺🇸 United StatesGemini 2.5 Pro Google DeepMind's thinking model for complex reasoning, code and long-context workGeneral · API only · 2025 Sahabat-AI 🇮🇩 Indonesia and 1 moreSahabat-AI Indonesian language model family by GoTo and IndosatRegional · Conditional licence AlphaCode 🇬🇧 United KingdomAlphaCode A code generation system that solves competitive programming problems.Code · Research only · 2022 ELECTRA WorldELECTRA A pre-training method that trains text encoders to spot replaced tokens.Research · Research only · 2020 imgClaude Opus 4.7 🇺🇸 United StatesClaude Opus 4.7 Anthropic's large model for long-running coding and professional workGeneral · API only · 2026 imgPixtral 12B 🇫🇷 FrancePixtral 12B A 12B multimodal model that reads images and text without losing text skillsMultimodal · Open weights · 2024 fnMistral NeMo 🇫🇷 FranceMistral NeMo A 12B multilingual open-weights model built with NVIDIA, with a 128k context window.General · Open weights · 2024 Grok 3 🇺🇸 United StatesGrok 3 xAI's reasoning-focused language model, released in beta in 2025General · API only · 2025 Aya Expanse WorldAya Expanse Open-weight multilingual language models in 8B and 32B sizes from Cohere For AIGeneral · Open weights · 2024

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.