News
EveryLLM

Text

Reads and writes text. 471 models on EveryLLM so far.

Text is the base modality of every language model: it reads a prompt and writes a reply, token by token. A tokenizer first splits text into tokens, which are whole words, pieces of words or single characters; in English a token is roughly three-quarters of a word. Everything else a model does, from code to reasoning to calling tools, is ultimately expressed as text that it reads or writes.

Tokens and context

Most models use byte-pair encoding, which builds a vocabulary of frequent character sequences. Vocabularies have grown from about 50,000 tokens in GPT-2 to around 200,000 in GPT-4o and 256,000 in Gemma. The context window is how many tokens the model can consider at once: GPT-3 handled 2,048 in 2020, while Gemini 1.5 Pro offered one million in 2024. Languages in non-Latin scripts often need more tokens for the same meaning.

What text-only still means

Many models remain text-only, especially smaller ones and older families such as GPT-3, Llama 2 and BERT, and text still carries most business uses: drafting, summarising, pulling fields out of documents, translation and search. Text-only models are cheaper to train and serve, and easier to evaluate, since their inputs and outputs can be checked and compared directly.

Famous text models

Further reading

fnGLM-5 馃嚚馃嚦 ChinaGLM-5 Open-weight model for engineering and agentic tasksGeneral 路 Open weights 路 2026 fnERNIE-4.5-21B-A3B-Thinking 馃嚚馃嚦 ChinaERNIE-4.5-21B-A3B-Thinking Lightweight reasoning model with 21 billion parametersReasoning 路 Open weights 路 2025 fnHunyuan-A13B 馃嚚馃嚦 ChinaHunyuan-A13B Open-source MoE language model with 80 billion total parametersGeneral 路 Open weights 路 2025 fnSeed-OSS-36B 馃嚚馃嚦 ChinaSeed-OSS-36B Open-source 36B parameter language model with controllable reasoning.General 路 Open weights 路 2025 imgStep3 馃嚚馃嚦 ChinaStep3 Multimodal reasoning model with 321 billion parametersMultimodal 路 Open weights 路 2025 imgvidIntern-S1 馃嚚馃嚦 ChinaIntern-S1 Open-source multimodal reasoning model for scienceReasoning 路 Open weights 路 2025 MiMo-7B 馃嚚馃嚦 ChinaMiMo-7B Open reasoning model from Xiaomi for maths and codeReasoning 路 Open weights 路 2025 Baichuan-M2 馃嚚馃嚦 ChinaBaichuan-M2 Open-source medical reasoning model with 32 billion parameters.Reasoning 路 Open weights 路 2025 K2-Think WorldK2-Think A 32 billion parameter open reasoning modelReasoning 路 Open weights 路 2025 fnStep-3.5-Flash 馃嚚馃嚦 ChinaStep-3.5-Flash Open-source MoE model for reasoning and agentsGeneral 路 Open weights 路 2026 EXAONE Deep 馃嚢馃嚪 South KoreaEXAONE Deep Reasoning-focused language models from LG AI ResearchReasoning 路 Open weights 路 2025 imgvidDiffusionGemma 馃嚭馃嚫 United StatesDiffusionGemma A multimodal Gemma 4 model that writes text by denoising blocks of tokens.Multimodal 路 Open weights imgvidGLM-4.1V-Thinking 馃嚚馃嚦 ChinaGLM-4.1V-Thinking Open-source vision-language model with reasoning focusMultimodal 路 Open weights 路 2025 fnGranite 4.2 馃嚭馃嚫 United StatesGranite 4.2 IBM's open reasoning language model family, released August 2026Reasoning 路 Open weights 路 2026 imgvidfnKimi K2.5 馃嚚馃嚦 ChinaKimi K2.5 Open-source multimodal agentic model with vision and reasoning.Multimodal 路 Open weights T-Pro 2.0 馃嚪馃嚭 RussiaT-Pro 2.0 Russian-tuned reasoning model based on Qwen 3Reasoning 路 Open weights Sarvam-105B 馃嚠馃嚦 IndiaSarvam-105B Open-weight MoE model for Indian languages and reasoningGeneral 路 Open weights DeepSeek-R1 馃嚚馃嚦 ChinaDeepSeek-R1 Open-weight reasoning model from ChinaReasoning 路 Open weights 路 2024

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.