News
EveryLLM

Text

Reads and writes text. 471 models on EveryLLM so far.

Text is the base modality of every language model: it reads a prompt and writes a reply, token by token. A tokenizer first splits text into tokens, which are whole words, pieces of words or single characters; in English a token is roughly three-quarters of a word. Everything else a model does, from code to reasoning to calling tools, is ultimately expressed as text that it reads or writes.

Tokens and context

Most models use byte-pair encoding, which builds a vocabulary of frequent character sequences. Vocabularies have grown from about 50,000 tokens in GPT-2 to around 200,000 in GPT-4o and 256,000 in Gemma. The context window is how many tokens the model can consider at once: GPT-3 handled 2,048 in 2020, while Gemini 1.5 Pro offered one million in 2024. Languages in non-Latin scripts often need more tokens for the same meaning.

What text-only still means

Many models remain text-only, especially smaller ones and older families such as GPT-3, Llama 2 and BERT, and text still carries most business uses: drafting, summarising, pulling fields out of documents, translation and search. Text-only models are cheaper to train and serve, and easier to evaluate, since their inputs and outputs can be checked and compared directly.

Famous text models

Further reading

1.58-bit large language model World1.58-bit large language model A model whose weights hold only three values: -1, 0 and +1.Research · Open weights · 2024 GPT-2 🇺🇸 United StatesGPT-2 OpenAI's 2019 text model that predicts the next word in a sequenceGeneral · Open weights · 2019 Apertus 🇨🇭 SwitzerlandApertus A Swiss public large language model released in 8B and 70B sizesGeneral · Open weights · 2025 Jais 🇦🇪 United Arab EmiratesJais An open Arabic and English large language model from the UAEGeneral · Open weights · 2023 imgwavInkling WorldInkling An open-weights mixture-of-experts model handling text, images and audio inputGeneral · Open weights · 2026 fnGLM 🇨🇳 ChinaGLM Open-weight Chinese model series used for chat and codingGeneral · Open weights · 2021 imgHuawei PanGu 🇨🇳 ChinaHuawei PanGu Huawei's multimodal large model family for industry, from 1B to trillion-scaleMultimodal · Open weights · 2023 GPT-J WorldGPT-J A 6-billion-parameter open English text generator from EleutherAI, released in 2021.General · Open weights · 2021 Minerva 🇮🇹 ItalyMinerva An Italian-first large language model trained from scratch at Sapienza University of Rome.General · Open weights · 2024 XLNet WorldXLNet Permutation-based autoregressive transformer model created by Google AIResearch · Open weights · 2019 wavWhisper WorldWhisper OpenAI's open-source model for turning speech into text and translating it.General · Open weights · 2022 imgwavvidGemma 🇺🇸 United StatesGemma Google DeepMind's open family of Gemini-derived language modelsGeneral · Open weights · 2024 GPT-1 WorldGPT-1 OpenAI's first GPT model, a 117M-parameter decoder-only transformer from 2018.Research · Open weights · 2018 imgfnPhi 🇺🇸 United StatesPhi Microsoft's family of small, open-weight language models that run on everyday devices.Small · Open weights · 2023 imgwavvidQwen 🇨🇳 ChinaQwen A family of large and small language models developed by Alibaba Cloud.General · Open weights · 2023 GPT-4chan WorldGPT-4chan A GPT-J model fine-tuned on posts from 4chan's /pol/ board.General · Open weights · 2022 Velvet AI 🇮🇹 ItalyVelvet AI Italian multilingual open-weight LLMs built for energy efficiencyGeneral · Open weights · 2025 IBM Granite 🇺🇸 United StatesIBM Granite IBM's decoder-only foundation models, from 3 to 34 billion parametersGeneral · Open weights · 2023 Phi-4 🇺🇸 United StatesPhi-4 A 14B Microsoft Research model trained heavily on synthetic data for reasoning.General · Open weights · 2024 Llama 2 🇺🇸 United StatesLlama 2 Meta's open family of pretrained and chat-tuned language models, 7B to 70BGeneral · Open weights · 2023 MT5 🇺🇸 United StatesMT5 A multilingual text-to-text transformer pretrained on 101 languagesGeneral · Open weights · 2020 Mixtral 8x22B 🇫🇷 FranceMixtral 8x22B Sparse mixture-of-experts open model with 39B active parameters out of 141BGeneral · Open weights imgvidfnGemma 3 🇺🇸 United StatesGemma 3 Lightweight multimodal open models from 1B to 27B parametersGeneral · Open weights · 2025 Gemma 2 🇺🇸 United StatesGemma 2 Open lightweight language models from Google DeepMind, 2B to 27B parametersGeneral · Open weights · 2024 imgwavvidGemma 4 🇺🇸 United StatesGemma 4 Google DeepMind's open multimodal models in five sizes, from phones to serversGeneral · Open weights RecurrentGemma 🇺🇸 United StatesRecurrentGemma Open language models using Google's Griffin recurrent-plus-attention architectureGeneral · Open weights · 2024 fnSolar Open 2 🇰🇷 South KoreaSolar Open 2 250B parameter open-weight model for agentic tasksGeneral · Open weights · 2026 fnGranite 4.2 🇺🇸 United StatesGranite 4.2 IBM's open reasoning language model family, released August 2026Reasoning · Open weights · 2026 Aya 101 WorldAya 101 A 13-billion-parameter multilingual model that follows instructions in 101 languagesGeneral · Open weights · 2024 fnBlenderBot 3 WorldBlenderBot 3 A 175B open-domain chatbot with internet access and long-term memoryGeneral · Open weights · 2022 fnGpt-oss-20b 🇺🇸 United StatesGpt-oss-20b OpenAI's smaller open-weight reasoning model for local and low-latency useReasoning · Open weights · 2025 DeepSeek-V2 🇨🇳 ChinaDeepSeek-V2 Efficient mixture-of-experts language model with 236 billion parametersGeneral · Open weights · 2024 ALLaM 🇸🇦 Saudi ArabiaALLaM Bilingual Arabic and English language model seriesGeneral · Open weights · 2024 Project Indus 🇮🇳 IndiaProject Indus Open-source language model for Hindi and dialectsGeneral · Open weights Sarvam-M 🇮🇳 IndiaSarvam-M Hybrid reasoning model for Indian languages and EnglishGeneral · Open weights · 2025 Falcon2-11B 🇦🇪 United Arab EmiratesFalcon2-11B An 11 billion parameter causal decoder model by TII.General · Open weights · 2024 Falcon-7B 🇦🇪 United Arab EmiratesFalcon-7B Open 7-billion parameter decoder model by TIIGeneral · Open weights · 2023 MiMo-V2-Flash 🇨🇳 ChinaMiMo-V2-Flash High-speed MoE language model for reasoning and agentsGeneral · Open weights ERNIE 5.5 Flash 🇨🇳 ChinaERNIE 5.5 Flash Efficient sparse MoE language model with 280B total parametersGeneral · Open weights imgYi-34B 🇨🇳 ChinaYi-34B A 34-billion parameter bilingual language model by 01.AIGeneral · Open weights · 2023 fnGpt-oss-120b 🇺🇸 United StatesGpt-oss-120b OpenAI's open-weight reasoning model that fits on one 80GB GPUReasoning · Open weights · 2025 Falcon 180B 🇦🇪 United Arab EmiratesFalcon 180B Open 180 billion parameter language model from TIIGeneral · Open weights · 2023 Swallow 🇯🇵 JapanSwallow Japanese-enhanced Llama models by Tokyo TechGeneral · Open weights · 2024 SEA-LION 🇸🇬 SingaporeSEA-LION Multilingual language models for Southeast AsiaGeneral · Open weights · 2025 SOLAR 10.7B 🇰🇷 South KoreaSOLAR 10.7B An 11-billion parameter language model using depth up-scaling.General · Open weights · 2023 Sarashina2 🇯🇵 JapanSarashina2 Open-weight Japanese and English language models by SB IntuitionsGeneral · Open weights RakutenAI-7B 🇯🇵 JapanRakutenAI-7B Japanese-focused open language model based on MistralGeneral · Open weights · 2024 PLLuM 🇵🇱 PolandPLLuM Polish-focused large language model familyGeneral · Open weights · 2024

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.