News
EveryLLM

Text

Reads and writes text. 471 models on EveryLLM so far.

Text is the base modality of every language model: it reads a prompt and writes a reply, token by token. A tokenizer first splits text into tokens, which are whole words, pieces of words or single characters; in English a token is roughly three-quarters of a word. Everything else a model does, from code to reasoning to calling tools, is ultimately expressed as text that it reads or writes.

Tokens and context

Most models use byte-pair encoding, which builds a vocabulary of frequent character sequences. Vocabularies have grown from about 50,000 tokens in GPT-2 to around 200,000 in GPT-4o and 256,000 in Gemma. The context window is how many tokens the model can consider at once: GPT-3 handled 2,048 in 2020, while Gemini 1.5 Pro offered one million in 2024. Languages in non-Latin scripts often need more tokens for the same meaning.

What text-only still means

Many models remain text-only, especially smaller ones and older families such as GPT-3, Llama 2 and BERT, and text still carries most business uses: drafting, summarising, pulling fields out of documents, translation and search. Text-only models are cheaper to train and serve, and easier to evaluate, since their inputs and outputs can be checked and compared directly.

Famous text models

Further reading

imgwavvidQwen 🇨🇳 ChinaQwen A family of large and small language models developed by Alibaba Cloud.General · Open weights · 2023 imgwavInkling WorldInkling An open-weights mixture-of-experts model handling text, images and audio inputGeneral · Open weights · 2026 imgLlama 🇺🇸 United StatesLlama Meta AI's family of open-weight language models, from 1B to 2T parametersGeneral · Conditional licence · 2023 imgAlice AI 🇷🇺 RussiaAlice AI Yandex's family of language, vision and image models behind the Alice assistantGeneral · API only · 2023 imgHuawei PanGu 🇨🇳 ChinaHuawei PanGu Huawei's multimodal large model family for industry, from 1B to trillion-scaleMultimodal · Open weights · 2023 DBRX WorldDBRX A 132-billion-parameter mixture-of-experts language model from Databricks.General · Conditional licence · 2024 imgfnMuse 🇺🇸 United StatesMuse Meta's multimodal LLM family, successor to Llama, with open and closed variantsGeneral · API only · 2026 imgwavvidGemini 🇺🇸 United StatesGemini Google DeepMind's multimodal LLM family, from Nano to UltraGeneral · API only · 2023 imgWu Dao 🇨🇳 ChinaWu Dao BAAI's trillion-parameter multimodal model family, announced 2021Multimodal · Research only · 2021 imgwavvidGemma 🇺🇸 United StatesGemma Google DeepMind's open family of Gemini-derived language modelsGeneral · Open weights · 2024 fnGLM 🇨🇳 ChinaGLM Open-weight Chinese model series used for chat and codingGeneral · Open weights · 2021 fnDeepSeek 🇨🇳 ChinaDeepSeek A Chinese series of large language models and a free chatbot appGeneral · API only · 2025 imgwavvidNemotron 🇺🇸 United StatesNemotron Nvidia family of language and multimodal models for enterprise and reasoningGeneral · Conditional licence · 2023 imgwavvidMiMo-V2.6-Pro 🇨🇳 ChinaMiMo-V2.6-Pro Xiaomi’s 1T parameter multimodal model with 1M token contextMultimodal · Open weights Seed1.5-Thinking 🇨🇳 ChinaSeed1.5-Thinking A reasoning model from ByteDance Seed using reinforcement learningReasoning · API only · 2025 NLLB-200 🇺🇸 United StatesNLLB-200 A research translation model covering 200 languages, built for low-resource ones.General · Conditional licence · 2022 imgPhi-3 🇺🇸 United StatesPhi-3 Small Microsoft language models built to run well on phones and laptops.Small · Open weights · 2024 DeepSeek-V3 🇨🇳 ChinaDeepSeek-V3 Open-weight mixture of experts language model with 671 billion parameters.General · Open weights · 2024 DeepSeekMoE 🇨🇳 ChinaDeepSeekMoE Mixture-of-experts language model architecture by DeepSeek AIGeneral · Open weights · 2024 Qwen2.5-Max 🇨🇳 ChinaQwen2.5-Max Large-scale mixture of experts model by Alibaba CloudGeneral · API only · 2025 fnKimi K2 Thinking 🇨🇳 ChinaKimi K2 Thinking Open-source reasoning model with tool use and INT4 quantizationReasoning · Open weights ERNIE 5.5 Flash 🇨🇳 ChinaERNIE 5.5 Flash Efficient sparse MoE language model with 280B total parametersGeneral · Open weights MiMo-V2-Flash 🇨🇳 ChinaMiMo-V2-Flash High-speed MoE language model for reasoning and agentsGeneral · Open weights PLLuM 🇵🇱 PolandPLLuM Polish-focused large language model familyGeneral · Open weights · 2024 Snowflake Arctic 🇺🇸 United StatesSnowflake Arctic Open enterprise language model with hybrid MoE designGeneral · Open weights · 2024 Mixtral 8x7B 🇫🇷 FranceMixtral 8x7B Sparse mixture-of-experts language model with open weightsGeneral · Open weights · 2023 fnParam-2-17B 🇮🇳 IndiaParam-2-17B Multilingual MoE model for Indian languages and reasoningGeneral · Open weights SUTRA WorldSUTRA Multilingual model separating concepts from language processingGeneral · Research only · 2024 DeepSeek-Coder-V2 🇨🇳 ChinaDeepSeek-Coder-V2 Open-source mixture-of-experts model for code and mathCode · Open weights · 2024 fnTrinity Large 🇺🇸 United StatesTrinity Large 398B-parameter sparse MoE model family by Arcee AIGeneral · Open weights · 2026 fnDeepSeek-V3.2 🇨🇳 ChinaDeepSeek-V3.2 Efficient reasoning and agentic AI model with sparse attentionReasoning · Open weights · 2025 fnDeepSeek-V3.1 🇨🇳 ChinaDeepSeek-V3.1 Hybrid thinking and non-thinking language model with 671 billion parameters.General · Open weights fnDeepSeek-V4-Pro 🇨🇳 ChinaDeepSeek-V4-Pro 1.6T parameter MoE model with one million token contextGeneral · Open weights · 2026 DeepSeek-V4-Flash 🇨🇳 ChinaDeepSeek-V4-Flash Efficient mixture-of-experts model with one million token contextGeneral · Open weights · 2026 Qwen1.5 🇨🇳 ChinaQwen1.5 Open-weight language model series with nine sizes and strong multilingual support.General · Open weights · 2024 fnK-EXAONE 2.0 🇰🇷 South KoreaK-EXAONE 2.0 Open-weight multilingual language model by LG AI ResearchGeneral · Open weights fnQwen3-235B-A22B 🇨🇳 ChinaQwen3-235B-A22B Mixture-of-experts model with switchable reasoning modesGeneral · Open weights · 2025 A.X K1 🇰🇷 South KoreaA.X K1 Sparse MoE model with controllable reasoning depthGeneral · Open weights · 2026 fnQwen3-Next-80B-A3B 🇨🇳 ChinaQwen3-Next-80B-A3B An 80-billion parameter hybrid model with ultra-long context support.General · Open weights imgfnQwen3.5-397B-A17B 🇨🇳 ChinaQwen3.5-397B-A17B A large multimodal language model with sparse activation.General · Open weights Solar Open 100B 🇰🇷 South KoreaSolar Open 100B 102B parameter Mixture-of-Experts model by UpstageGeneral · Conditional licence · 2026 fnKanana-2 🇰🇷 South KoreaKanana-2 Open-source multilingual model for agentic AI and reasoning.General · Open weights fnKimi K2 🇨🇳 ChinaKimi K2 Open mixture-of-experts model for agentic tasks and codingGeneral · Open weights · 2025 imgvidfnKimi K2.6 🇨🇳 ChinaKimi K2.6 Open-source multimodal agentic model by Moonshot AIGeneral · Open weights fnGLM-4.5 🇨🇳 ChinaGLM-4.5 Open-source mixture of experts model for agents and reasoningGeneral · Open weights · 2025 Kimi Linear 🇨🇳 ChinaKimi Linear Hybrid linear attention model with 48 billion parametersGeneral · Open weights · 2025 imgfnLing-1T 🇨🇳 ChinaLing-1T Trillion-parameter efficient reasoning model by InclusionAIGeneral · Open weights fnLongCat-2.0 🇨🇳 ChinaLongCat-2.0 A 1.6 trillion parameter MoE language model from Meituan.General · Open weights

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.