News
EveryLLM

Text

Reads and writes text. 471 models on EveryLLM so far.

Text is the base modality of every language model: it reads a prompt and writes a reply, token by token. A tokenizer first splits text into tokens, which are whole words, pieces of words or single characters; in English a token is roughly three-quarters of a word. Everything else a model does, from code to reasoning to calling tools, is ultimately expressed as text that it reads or writes.

Tokens and context

Most models use byte-pair encoding, which builds a vocabulary of frequent character sequences. Vocabularies have grown from about 50,000 tokens in GPT-2 to around 200,000 in GPT-4o and 256,000 in Gemma. The context window is how many tokens the model can consider at once: GPT-3 handled 2,048 in 2020, while Gemini 1.5 Pro offered one million in 2024. Languages in non-Latin scripts often need more tokens for the same meaning.

What text-only still means

Many models remain text-only, especially smaller ones and older families such as GPT-3, Llama 2 and BERT, and text still carries most business uses: drafting, summarising, pulling fields out of documents, translation and search. Text-only models are cheaper to train and serve, and easier to evaluate, since their inputs and outputs can be checked and compared directly.

Famous text models

Further reading

fnNemotron Nano 2 馃嚭馃嚫 United StatesNemotron Nano 2 A 9B hybrid Mamba-Transformer model for reasoning and chat, from NVIDIA.General 路 Open weights 路 2025 Mistral 7B 馃嚝馃嚪 FranceMistral 7B A 7.3 billion parameter open language model from Mistral AIGeneral 路 Open weights 路 2023 GLM-130B 馃嚚馃嚦 ChinaGLM-130B Open bilingual pre-trained language model with 130 billion parametersGeneral 路 Open weights 路 2022 fnParam-2-17B 馃嚠馃嚦 IndiaParam-2-17B Multilingual MoE model for Indian languages and reasoningGeneral 路 Open weights imgfnGLM-4 馃嚚馃嚦 ChinaGLM-4 Multilingual large language model series by Zhipu AIGeneral 路 Open weights 路 2024 OpenHathi 馃嚠馃嚦 IndiaOpenHathi A 7 billion parameter language model for Hindi and English.General 路 Open weights imgMistral Medium 3.5 馃嚝馃嚪 FranceMistral Medium 3.5 A 128B multimodal model with a 256k window for chat, reasoning and codingGeneral 路 Open weights fnMagistral 馃嚝馃嚪 FranceMagistral Mistral AI's first reasoning model, in open and enterprise versionsReasoning 路 Open weights 路 2025 DeepSeekMoE 馃嚚馃嚦 ChinaDeepSeekMoE Mixture-of-experts language model architecture by DeepSeek AIGeneral 路 Open weights 路 2024 Meditron WorldMeditron Open-source medical language models based on Llama-2.Domain 路 Open weights 路 2023 DeepSeek-Coder-V2 馃嚚馃嚦 ChinaDeepSeek-Coder-V2 Open-source mixture-of-experts model for code and mathCode 路 Open weights 路 2024 RWKV-7 Goose WorldRWKV-7 Goose Recurrent language model with constant memory usageGeneral 路 Open weights 路 2025 Zamba WorldZamba A 7-billion parameter hybrid language model combining Mamba and transformer layers.General 路 Open weights 路 2024 Teuken-7B 馃嚛馃嚜 GermanyTeuken-7B Multilingual LLM for all 24 official EU languagesGeneral 路 Open weights 路 2024 fnLFM2 馃嚭馃嚫 United StatesLFM2 Hybrid language models for edge and on-device useSmall 路 Open weights TinyLlama WorldTinyLlama A compact 1.1 billion parameter open language model.Small 路 Open weights 路 2023 Cerebras-GPT 馃嚭馃嚫 United StatesCerebras-GPT Open compute-optimal language models from Cerebras SystemsGeneral 路 Open weights 路 2023 LLaDA WorldLLaDA An 8-billion parameter diffusion language modelGeneral 路 Open weights 路 2025 StableLM 2 馃嚞馃嚙 United KingdomStableLM 2 A small open-weight language model by Stability AIGeneral 路 Open weights 路 2024 fnHermes 3 馃嚭馃嚫 United StatesHermes 3 Open-weight instruct model based on Llama-3.1 405BGeneral 路 Open weights 路 2024 fnTrinity Large 馃嚭馃嚫 United StatesTrinity Large 398B-parameter sparse MoE model family by Arcee AIGeneral 路 Open weights 路 2026 imgJanus-Pro 馃嚚馃嚦 ChinaJanus-Pro Unified multimodal model for understanding and generating imagesMultimodal 路 Open weights 路 2025 fnDeepSeek-V3.2 馃嚚馃嚦 ChinaDeepSeek-V3.2 Efficient reasoning and agentic AI model with sparse attentionReasoning 路 Open weights 路 2025 fnDeepSeek-V3.1 馃嚚馃嚦 ChinaDeepSeek-V3.1 Hybrid thinking and non-thinking language model with 671 billion parameters.General 路 Open weights GPT-NeoX-20B 馃嚭馃嚫 United StatesGPT-NeoX-20B Open 20 billion parameter autoregressive language model by EleutherAIGeneral 路 Open weights 路 2022 fnDeepSeek-V4-Pro 馃嚚馃嚦 ChinaDeepSeek-V4-Pro 1.6T parameter MoE model with one million token contextGeneral 路 Open weights 路 2026 fnSmolLM3 馃嚭馃嚫 United StatesSmolLM3 Open 3B parameter language model with reasoning modesGeneral 路 Open weights StarCoder WorldStarCoder Open code generation model with 15.5 billion parametersCode 路 Open weights 路 2023 SmolLM2 馃嚭馃嚫 United StatesSmolLM2 Compact language models for on-device useGeneral 路 Open weights 路 2025 Zephyr 7B 馃嚭馃嚫 United StatesZephyr 7B A 7 billion parameter chat model fine-tuned for helpfulness.Assistant 路 Open weights 路 2023 GPT-Neo WorldGPT-Neo Open autoregressive language model by EleutherAIGeneral 路 Open weights ALIA-40b 馃嚜馃嚫 SpainALIA-40b Multilingual base model for 35 European languagesGeneral 路 Open weights OLMo 2 馃嚭馃嚫 United StatesOLMo 2 Open language model family with full training transparencyGeneral 路 Open weights 路 2024 OLMo 3 馃嚭馃嚫 United StatesOLMo 3 Open language models for scientific research by Allen Institute for AIGeneral 路 Open weights 路 2025 T眉lu 3 馃嚭馃嚫 United StatesT眉lu 3 Open post-trained model family built on Llama 3.1General 路 Open weights 路 2024 DeepSeek-V4-Flash 馃嚚馃嚦 ChinaDeepSeek-V4-Flash Efficient mixture-of-experts model with one million token contextGeneral 路 Open weights 路 2026 imgDeepSeek-V4.1-Flash 馃嚚馃嚦 ChinaDeepSeek-V4.1-Flash Multimodal MoE model with efficient KV cache compressionMultimodal 路 Open weights Qwen-72B 馃嚚馃嚦 ChinaQwen-72B A 72-billion parameter open-weight language model from Alibaba Cloud.General 路 Open weights 路 2023 Qwen1.5 馃嚚馃嚦 ChinaQwen1.5 Open-weight language model series with nine sizes and strong multilingual support.General 路 Open weights 路 2024 fnK-EXAONE 2.0 馃嚢馃嚪 South KoreaK-EXAONE 2.0 Open-weight multilingual language model by LG AI ResearchGeneral 路 Open weights Pharia-1-LLM-7B 馃嚛馃嚜 GermanyPharia-1-LLM-7B Multilingual 7B parameter decoder model by Aleph Alpha ResearchGeneral 路 Open weights CroissantLLM 馃嚝馃嚪 FranceCroissantLLM A 1.3 billion parameter bilingual French-English language model.General 路 Open weights 路 2024 Lucie-7B 馃嚝馃嚪 FranceLucie-7B Open multilingual language model focused on French and EnglishGeneral 路 Open weights 路 2025 PhoGPT 馃嚮馃嚦 VietnamPhoGPT Open-source generative model for Vietnamese language tasks.General 路 Open weights 路 2023 Bielik 馃嚨馃嚤 PolandBielik Polish-optimised 11 billion parameter language modelGeneral 路 Open weights 路 2025 BLOOMZ WorldBLOOMZ Multilingual instruction-following model based on BLOOMGeneral 路 Open weights 路 2022 fnQwQ-32B 馃嚚馃嚦 ChinaQwQ-32B A 32-billion parameter reasoning model from the Qwen series.Reasoning 路 Open weights 路 2025 fnQwen3-235B-A22B 馃嚚馃嚦 ChinaQwen3-235B-A22B Mixture-of-experts model with switchable reasoning modesGeneral 路 Open weights 路 2025

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.