News
EveryLLM

Text

Reads and writes text. 471 models on EveryLLM so far.

Text is the base modality of every language model: it reads a prompt and writes a reply, token by token. A tokenizer first splits text into tokens, which are whole words, pieces of words or single characters; in English a token is roughly three-quarters of a word. Everything else a model does, from code to reasoning to calling tools, is ultimately expressed as text that it reads or writes.

Tokens and context

Most models use byte-pair encoding, which builds a vocabulary of frequent character sequences. Vocabularies have grown from about 50,000 tokens in GPT-2 to around 200,000 in GPT-4o and 256,000 in Gemma. The context window is how many tokens the model can consider at once: GPT-3 handled 2,048 in 2020, while Gemini 1.5 Pro offered one million in 2024. Languages in non-Latin scripts often need more tokens for the same meaning.

What text-only still means

Many models remain text-only, especially smaller ones and older families such as GPT-3, Llama 2 and BERT, and text still carries most business uses: drafting, summarising, pulling fields out of documents, translation and search. Text-only models are cheaper to train and serve, and easier to evaluate, since their inputs and outputs can be checked and compared directly.

Famous text models

Further reading

Qwen2 馃嚚馃嚦 ChinaQwen2 Open-weight language model series from AlibabaGeneral 路 Open weights 路 2024 Qwen2.5-Coder 馃嚚馃嚦 ChinaQwen2.5-Coder Open code-specialised language model series by Alibaba CloudCode 路 Open weights 路 2024 fnGLM-5 馃嚚馃嚦 ChinaGLM-5 Open-weight model for engineering and agentic tasksGeneral 路 Open weights 路 2026 Granite 3.0 馃嚭馃嚫 United StatesGranite 3.0 IBM's third-generation open enterprise language models, from 2B to 8B parametersGeneral 路 Open weights 路 2024 Aya 101 WorldAya 101 A 13-billion-parameter multilingual model that follows instructions in 101 languagesGeneral 路 Open weights 路 2024 Falcon-7B 馃嚘馃嚜 United Arab EmiratesFalcon-7B Open 7-billion parameter decoder model by TIIGeneral 路 Open weights 路 2023 fnGranite 4.2 馃嚭馃嚫 United StatesGranite 4.2 IBM's open reasoning language model family, released August 2026Reasoning 路 Open weights 路 2026 fnGranite 4.0 馃嚭馃嚫 United StatesGranite 4.0 IBM's hybrid Mamba/transformer language models for enterprise workGeneral 路 Open weights 路 2025 imgfnMistral Large 3 馃嚝馃嚪 FranceMistral Large 3 A 675B-parameter open-weight mixture-of-experts multimodal model from Mistral AIGeneral 路 Open weights ALLaM 馃嚫馃嚘 Saudi ArabiaALLaM Bilingual Arabic and English language model seriesGeneral 路 Open weights 路 2024 fnSolar Open 2 馃嚢馃嚪 South KoreaSolar Open 2 250B parameter open-weight model for agentic tasksGeneral 路 Open weights 路 2026 Mixtral 8x22B 馃嚝馃嚪 FranceMixtral 8x22B Sparse mixture-of-experts open model with 39B active parameters out of 141BGeneral 路 Open weights Phi-2 馃嚭馃嚫 United StatesPhi-2 A 2.7 billion parameter Microsoft research model for QA, chat and codeResearch 路 Open weights fnGpt-oss-120b 馃嚭馃嚫 United StatesGpt-oss-120b OpenAI's open-weight reasoning model that fits on one 80GB GPUReasoning 路 Open weights 路 2025 Falcon2-11B 馃嚘馃嚜 United Arab EmiratesFalcon2-11B An 11 billion parameter causal decoder model by TII.General 路 Open weights 路 2024 DeepSeek-V2 馃嚚馃嚦 ChinaDeepSeek-V2 Efficient mixture-of-experts language model with 236 billion parametersGeneral 路 Open weights 路 2024 fnGpt-oss-20b 馃嚭馃嚫 United StatesGpt-oss-20b OpenAI's smaller open-weight reasoning model for local and low-latency useReasoning 路 Open weights 路 2025 Gemma 2 馃嚭馃嚫 United StatesGemma 2 Open lightweight language models from Google DeepMind, 2B to 27B parametersGeneral 路 Open weights 路 2024 imgvidfnGemma 3 馃嚭馃嚫 United StatesGemma 3 Lightweight multimodal open models from 1B to 27B parametersGeneral 路 Open weights 路 2025 imgwavvidGemma 4 馃嚭馃嚫 United StatesGemma 4 Google DeepMind's open multimodal models in five sizes, from phones to serversGeneral 路 Open weights imgvidfnStep-5-Preview WorldStep-5-Preview Agentic model with 600B parameters and 1M token contextGeneral 路 Open weights 路 2026 fnK-EXAONE 馃嚢馃嚪 South KoreaK-EXAONE LG AI Research multilingual Mixture-of-Experts modelGeneral 路 Open weights Sailor 馃嚫馃嚞 SingaporeSailor Open multilingual language models for South-East AsiaGeneral 路 Open weights 路 2024 imgPixtral 12B 馃嚝馃嚪 FrancePixtral 12B A 12B multimodal model that reads images and text without losing text skillsMultimodal 路 Open weights 路 2024 fnMistral NeMo 馃嚝馃嚪 FranceMistral NeMo A 12B multilingual open-weights model built with NVIDIA, with a 128k context window.General 路 Open weights 路 2024 Aya Expanse WorldAya Expanse Open-weight multilingual language models in 8B and 32B sizes from Cohere For AIGeneral 路 Open weights 路 2024 Zamba2 馃嚭馃嚫 United StatesZamba2 Hybrid Mamba2-transformer language model suite by ZyphraGeneral 路 Open weights 路 2024 Grok-1 馃嚭馃嚫 United StatesGrok-1 xAI's 314 billion parameter open-weights mixture-of-experts base modelGeneral 路 Open weights 路 2024 Sarvam-105B 馃嚠馃嚦 IndiaSarvam-105B Open-weight MoE model for Indian languages and reasoningGeneral 路 Open weights Hunyuan-Large 馃嚚馃嚦 ChinaHunyuan-Large Open-source mixture of experts model with 389 billion parametersGeneral 路 Open weights 路 2024 imgSalamandra 馃嚜馃嚫 SpainSalamandra Open multilingual language models for European languagesGeneral 路 Open weights 路 2025 fnMiniMax-M2 馃嚚馃嚦 ChinaMiniMax-M2 Open-source MoE model for coding and agentsCode 路 Open weights Falcon Mamba 7B 馃嚘馃嚜 United Arab EmiratesFalcon Mamba 7B A 7-billion parameter language model using the Mamba architecture.General 路 Open weights 路 2024 imgvidfnKimi K3 馃嚚馃嚦 ChinaKimi K3 Open-weight multimodal agentic model with 2.8T parametersGeneral 路 Open weights 路 2026 ModernBERT 馃嚭馃嚫 United States and 1 moreModernBERT A modernised encoder model for retrieval and classification tasks.Encoder 路 Open weights 路 2024 Granite Code 馃嚭馃嚫 United StatesGranite Code IBM's open code models from 3B to 34B parameters for coding tasksCode 路 Open weights 路 2024 fnInternLM2 馃嚚馃嚦 ChinaInternLM2 Open-source 20 billion parameter language model with long context supportGeneral 路 Open weights 路 2024 Meltemi 馃嚞馃嚪 GreeceMeltemi Open large language model for GreekGeneral 路 Open weights 路 2024 wavVoxtral 馃嚝馃嚪 FranceVoxtral Open audio chat models that transcribe, answer questions and summarise speechMultimodal 路 Open weights 路 2025 Mi:dm 2.0 馃嚢馃嚪 South KoreaMi:dm 2.0 Korea-centric language model by KTGeneral 路 Open weights 路 2025 RWKV-4 WorldRWKV-4 A dense recurrent model with transformer-level performanceGeneral 路 Open weights 路 2023 CyberAgentLM3 馃嚡馃嚨 JapanCyberAgentLM3 A 22-billion parameter Japanese and English chat model by CyberAgent.General 路 Open weights DeepSeek-R1 馃嚚馃嚦 ChinaDeepSeek-R1 Open-weight reasoning model from ChinaReasoning 路 Open weights 路 2024 Jamba 馃嚠馃嚤 IsraelJamba Hybrid open-weights language model with long contextGeneral 路 Open weights 路 2024

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.