News
EveryLLM

Text

Reads and writes text. 471 models on EveryLLM so far.

Text is the base modality of every language model: it reads a prompt and writes a reply, token by token. A tokenizer first splits text into tokens, which are whole words, pieces of words or single characters; in English a token is roughly three-quarters of a word. Everything else a model does, from code to reasoning to calling tools, is ultimately expressed as text that it reads or writes.

Tokens and context

Most models use byte-pair encoding, which builds a vocabulary of frequent character sequences. Vocabularies have grown from about 50,000 tokens in GPT-2 to around 200,000 in GPT-4o and 256,000 in Gemma. The context window is how many tokens the model can consider at once: GPT-3 handled 2,048 in 2020, while Gemini 1.5 Pro offered one million in 2024. Languages in non-Latin scripts often need more tokens for the same meaning.

What text-only still means

Many models remain text-only, especially smaller ones and older families such as GPT-3, Llama 2 and BERT, and text still carries most business uses: drafting, summarising, pulling fields out of documents, translation and search. Text-only models are cheaper to train and serve, and easier to evaluate, since their inputs and outputs can be checked and compared directly.

Famous text models

Further reading

fnLongCat-2.0 馃嚚馃嚦 ChinaLongCat-2.0 A 1.6 trillion parameter MoE language model from Meituan.General 路 Open weights MiniMax-Text-01 馃嚚馃嚦 ChinaMiniMax-Text-01 A large language model with a four million token context window.General 路 Open weights 路 2025 fnMiniMax-M1 馃嚚馃嚦 ChinaMiniMax-M1 Open-weight reasoning model with hybrid attention and long contextReasoning 路 Open weights 路 2025 wavfnSarvam-30B 馃嚠馃嚦 IndiaSarvam-30B Open-weight MoE model for Indian languages and codingGeneral 路 Open weights fnLongCat-Flash 馃嚚馃嚦 ChinaLongCat-Flash Efficient 560B parameter MoE model for agentic tasksGeneral 路 Open weights 路 2025 fnGLM-5 馃嚚馃嚦 ChinaGLM-5 Open-weight model for engineering and agentic tasksGeneral 路 Open weights 路 2026 fnERNIE-4.5-21B-A3B-Thinking 馃嚚馃嚦 ChinaERNIE-4.5-21B-A3B-Thinking Lightweight reasoning model with 21 billion parametersReasoning 路 Open weights 路 2025 imgERNIE 4.5 馃嚚馃嚦 ChinaERNIE 4.5 Baidu's multimodal mixture-of-experts language model series.General 路 Open weights 路 2025 fnHunyuan-A13B 馃嚚馃嚦 ChinaHunyuan-A13B Open-source MoE language model with 80 billion total parametersGeneral 路 Open weights 路 2025 imgStep3 馃嚚馃嚦 ChinaStep3 Multimodal reasoning model with 321 billion parametersMultimodal 路 Open weights 路 2025 imgvidIntern-S1 馃嚚馃嚦 ChinaIntern-S1 Open-source multimodal reasoning model for scienceReasoning 路 Open weights 路 2025 MiMo-V2.5-Pro 馃嚚馃嚦 ChinaMiMo-V2.5-Pro Open-source MoE language model with 1M token contextGeneral 路 Open weights imgwavvidMiMo-V2.6-Pro 馃嚚馃嚦 ChinaMiMo-V2.6-Pro Xiaomi鈥檚 1T parameter multimodal model with 1M token contextMultimodal 路 Open weights fnStep-3.5-Flash 馃嚚馃嚦 ChinaStep-3.5-Flash Open-source MoE model for reasoning and agentsGeneral 路 Open weights 路 2026 imgvidDiffusionGemma 馃嚭馃嚫 United StatesDiffusionGemma A multimodal Gemma 4 model that writes text by denoising blocks of tokens.Multimodal 路 Open weights Qwen2 馃嚚馃嚦 ChinaQwen2 Open-weight language model series from AlibabaGeneral 路 Open weights 路 2024 imgfnLeanstral 1.5 馃嚝馃嚪 FranceLeanstral 1.5 An open code agent model built for the Lean 4 proof assistantCode 路 Open weights fnGranite 4.0 馃嚭馃嚫 United StatesGranite 4.0 IBM's hybrid Mamba/transformer language models for enterprise workGeneral 路 Open weights 路 2025 imgfnMistral Large 3 馃嚝馃嚪 FranceMistral Large 3 A 675B-parameter open-weight mixture-of-experts multimodal model from Mistral AIGeneral 路 Open weights fnSolar Open 2 馃嚢馃嚪 South KoreaSolar Open 2 250B parameter open-weight model for agentic tasksGeneral 路 Open weights 路 2026 Mixtral 8x22B 馃嚝馃嚪 FranceMixtral 8x22B Sparse mixture-of-experts open model with 39B active parameters out of 141BGeneral 路 Open weights fnGpt-oss-120b 馃嚭馃嚫 United StatesGpt-oss-120b OpenAI's open-weight reasoning model that fits on one 80GB GPUReasoning 路 Open weights 路 2025 fnK-EXAONE 馃嚢馃嚪 South KoreaK-EXAONE LG AI Research multilingual Mixture-of-Experts modelGeneral 路 Open weights Granite 3.0 馃嚭馃嚫 United StatesGranite 3.0 IBM's third-generation open enterprise language models, from 2B to 8B parametersGeneral 路 Open weights 路 2024 imgDeepSeek-OCR WorldDeepSeek-OCR Optical character recognition model using visual compressionMultimodal 路 Open weights 路 2025 Grok-1 馃嚭馃嚫 United StatesGrok-1 xAI's 314 billion parameter open-weights mixture-of-experts base modelGeneral 路 Open weights 路 2024 imgvidfnKimi K2.5 馃嚚馃嚦 ChinaKimi K2.5 Open-source multimodal agentic model with vision and reasoning.Multimodal 路 Open weights Sarvam-105B 馃嚠馃嚦 IndiaSarvam-105B Open-weight MoE model for Indian languages and reasoningGeneral 路 Open weights Hunyuan-Large 馃嚚馃嚦 ChinaHunyuan-Large Open-source mixture of experts model with 389 billion parametersGeneral 路 Open weights 路 2024 fnMiniMax-M2 馃嚚馃嚦 ChinaMiniMax-M2 Open-source MoE model for coding and agentsCode 路 Open weights imgvidfnKimi K3 馃嚚馃嚦 ChinaKimi K3 Open-weight multimodal agentic model with 2.8T parametersGeneral 路 Open weights 路 2026 imgvidfnStep-5-Preview WorldStep-5-Preview Agentic model with 600B parameters and 1M token contextGeneral 路 Open weights 路 2026 DeepSeek-R1 馃嚚馃嚦 ChinaDeepSeek-R1 Open-weight reasoning model from ChinaReasoning 路 Open weights 路 2024 Jamba 馃嚠馃嚤 IsraelJamba Hybrid open-weights language model with long contextGeneral 路 Open weights 路 2024

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.