News
EveryLLM

Text

Reads and writes text. 471 models on EveryLLM so far.

Text is the base modality of every language model: it reads a prompt and writes a reply, token by token. A tokenizer first splits text into tokens, which are whole words, pieces of words or single characters; in English a token is roughly three-quarters of a word. Everything else a model does, from code to reasoning to calling tools, is ultimately expressed as text that it reads or writes.

Tokens and context

Most models use byte-pair encoding, which builds a vocabulary of frequent character sequences. Vocabularies have grown from about 50,000 tokens in GPT-2 to around 200,000 in GPT-4o and 256,000 in Gemma. The context window is how many tokens the model can consider at once: GPT-3 handled 2,048 in 2020, while Gemini 1.5 Pro offered one million in 2024. Languages in non-Latin scripts often need more tokens for the same meaning.

What text-only still means

Many models remain text-only, especially smaller ones and older families such as GPT-3, Llama 2 and BERT, and text still carries most business uses: drafting, summarising, pulling fields out of documents, translation and search. Text-only models are cheaper to train and serve, and easier to evaluate, since their inputs and outputs can be checked and compared directly.

Famous text models

Further reading

wavfnSarvam-30B 馃嚠馃嚦 IndiaSarvam-30B Open-weight MoE model for Indian languages and codingGeneral 路 Open weights PanGu-Sigma 馃嚚馃嚦 ChinaPanGu-Sigma Trillion-parameter sparse language model for Chinese NLP tasksGeneral 路 Research only 路 2023 fnGLM-5 馃嚚馃嚦 ChinaGLM-5 Open-weight model for engineering and agentic tasksGeneral 路 Open weights 路 2026 ERNIE 3.0 馃嚚馃嚦 ChinaERNIE 3.0 Knowledge-enhanced pre-training model for language tasksGeneral 路 Research only 路 2021 ERNIE 3.0 Titan 馃嚚馃嚦 ChinaERNIE 3.0 Titan Large-scale Chinese knowledge-enhanced pre-trained language modelGeneral 路 Research only 路 2021 imgERNIE 4.5 馃嚚馃嚦 ChinaERNIE 4.5 Baidu's multimodal mixture-of-experts language model series.General 路 Open weights 路 2025 fnHunyuan-A13B 馃嚚馃嚦 ChinaHunyuan-A13B Open-source MoE language model with 80 billion total parametersGeneral 路 Open weights 路 2025 Hunyuan-TurboS 馃嚚馃嚦 ChinaHunyuan-TurboS Hybrid Mamba-Transformer MoE model by TencentGeneral 路 API only 路 2025 Seed1.5-Thinking 馃嚚馃嚦 ChinaSeed1.5-Thinking A reasoning model from ByteDance Seed using reinforcement learningReasoning 路 API only 路 2025 fnSeed-OSS-36B 馃嚚馃嚦 ChinaSeed-OSS-36B Open-source 36B parameter language model with controllable reasoning.General 路 Open weights 路 2025 Pangu Ultra 馃嚚馃嚦 ChinaPangu Ultra A 135-billion parameter dense language model trained on Ascend hardware.General 路 API only 路 2025 imgvidfnInternVL3 馃嚚馃嚦 ChinaInternVL3 Open-source multimodal large language model seriesMultimodal 路 Open weights 路 2025 MiMo-V2.5-Pro 馃嚚馃嚦 ChinaMiMo-V2.5-Pro Open-source MoE language model with 1M token contextGeneral 路 Open weights Baichuan 2 馃嚚馃嚦 ChinaBaichuan 2 Open multilingual language models with 7B and 13B parameters.General 路 Open weights 路 2023 imgwavvidMiMo-V2.6-Pro 馃嚚馃嚦 ChinaMiMo-V2.6-Pro Xiaomi鈥檚 1T parameter multimodal model with 1M token contextMultimodal 路 Open weights imgNVLM 1.0 馃嚭馃嚫 United StatesNVLM 1.0 Open multimodal language models from NVIDIA for vision and language tasksMultimodal 路 Open weights 路 2024 K2-Think WorldK2-Think A 32 billion parameter open reasoning modelReasoning 路 Open weights 路 2025 Fugaku-LLM 馃嚡馃嚨 JapanFugaku-LLM Japanese large language model trained on Fugaku supercomputerGeneral 路 Open weights 路 2024 fnStep-3.5-Flash 馃嚚馃嚦 ChinaStep-3.5-Flash Open-source MoE model for reasoning and agentsGeneral 路 Open weights 路 2026 Qwen2.5-72B 馃嚚馃嚦 ChinaQwen2.5-72B A 72-billion parameter open-weight language model from Alibaba Cloud.General 路 Open weights 路 2024 MAI-1-preview 馃嚭馃嚫 United StatesMAI-1-preview Microsoft AI's first in-house foundation model, a mixture-of-experts system for everyday queriesGeneral 路 API only 路 2025 Gemini Diffusion 馃嚭馃嚫 United StatesGemini Diffusion Experimental text diffusion model from Google DeepMindGeneral 路 Research only CodeGen 馃嚭馃嚫 United StatesCodeGen Open autoregressive language model for code generationCode 路 Open weights 路 2022 EXAONE Deep 馃嚢馃嚪 South KoreaEXAONE Deep Reasoning-focused language models from LG AI ResearchReasoning 路 Open weights 路 2025 DeepSeek Coder 馃嚚馃嚦 ChinaDeepSeek Coder Open-source code generation models from DeepSeekCode 路 Open weights 路 2024 fnMistral Small 3 馃嚝馃嚪 FranceMistral Small 3 A 24B open-weight model tuned for low latency and local deploymentGeneral 路 Open weights 路 2025 OPT 馃嚭馃嚫 United StatesOPT Meta AI's family of open decoder-only language models from 125M to 175B parametersGeneral 路 Conditional licence 路 2022 fnTyphoon 馃嚬馃嚟 ThailandTyphoon Thai-focused large language model series by SCB 10XGeneral 路 Conditional licence 路 2024 Flan-T5 馃嚭馃嚫 United StatesFlan-T5 Instruction-finetuned T5 checkpoints released by Google for zero-shot and few-shot workGeneral 路 Open weights 路 2022 Llama 3 馃嚭馃嚫 United StatesLlama 3 Meta's open-weight language model family in 8B and 70B sizesGeneral 路 Conditional licence 路 2024 Jamba2 Mini WorldJamba2 Mini A small open-weights SSM-Transformer model for enterprise workSmall 路 Open weights fnMinistral 3B and 8B 馃嚝馃嚪 FranceMinistral 3B and 8B Two small Mistral AI models built for on-device and edge computing.Small 路 API only 路 2024 Qwen2 馃嚚馃嚦 ChinaQwen2 Open-weight language model series from AlibabaGeneral 路 Open weights 路 2024 Qwen2.5-Coder 馃嚚馃嚦 ChinaQwen2.5-Coder Open code-specialised language model series by Alibaba CloudCode 路 Open weights 路 2024 Sailor 馃嚫馃嚞 SingaporeSailor Open multilingual language models for South-East AsiaGeneral 路 Open weights 路 2024 imgwavvidGemini 2.5 Pro 馃嚭馃嚫 United StatesGemini 2.5 Pro Google DeepMind's thinking model for complex reasoning, code and long-context workGeneral 路 API only 路 2025 imgClaude Opus 4.7 馃嚭馃嚫 United StatesClaude Opus 4.7 Anthropic's large model for long-running coding and professional workGeneral 路 API only 路 2026 imgPixtral 12B 馃嚝馃嚪 FrancePixtral 12B A 12B multimodal model that reads images and text without losing text skillsMultimodal 路 Open weights 路 2024 fnMistral NeMo 馃嚝馃嚪 FranceMistral NeMo A 12B multilingual open-weights model built with NVIDIA, with a 128k context window.General 路 Open weights 路 2024 Grok 3 馃嚭馃嚫 United StatesGrok 3 xAI's reasoning-focused language model, released in beta in 2025General 路 API only 路 2025 Aya Expanse WorldAya Expanse Open-weight multilingual language models in 8B and 32B sizes from Cohere For AIGeneral 路 Open weights 路 2024 Zamba2 馃嚭馃嚫 United StatesZamba2 Hybrid Mamba2-transformer language model suite by ZyphraGeneral 路 Open weights 路 2024 Poro 馃嚝馃嚠 FinlandPoro Open 34B parameter model for Finnish, English and codeGeneral 路 Fully open 路 2024 Grok-1 馃嚭馃嚫 United StatesGrok-1 xAI's 314 billion parameter open-weights mixture-of-experts base modelGeneral 路 Open weights 路 2024 Gemini 2.5 Flash 馃嚭馃嚫 United StatesGemini 2.5 Flash A hybrid reasoning model from Google with adjustable thinking effortGeneral 路 API only 路 2025 Sarvam-105B 馃嚠馃嚦 IndiaSarvam-105B Open-weight MoE model for Indian languages and reasoningGeneral 路 Open weights imgwavvidReka Core 馃嚫馃嚞 SingaporeReka Core Multimodal language model by RekaMultimodal 路 API only 路 2024 fnLlama 3.3 70B 馃嚭馃嚫 United StatesLlama 3.3 70B A text-only 70B instruction-tuned model from Meta's Llama 3 line.General 路 Conditional licence

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.