News
EveryLLM

Text

Reads and writes text. 471 models on EveryLLM so far.

Text is the base modality of every language model: it reads a prompt and writes a reply, token by token. A tokenizer first splits text into tokens, which are whole words, pieces of words or single characters; in English a token is roughly three-quarters of a word. Everything else a model does, from code to reasoning to calling tools, is ultimately expressed as text that it reads or writes.

Tokens and context

Most models use byte-pair encoding, which builds a vocabulary of frequent character sequences. Vocabularies have grown from about 50,000 tokens in GPT-2 to around 200,000 in GPT-4o and 256,000 in Gemma. The context window is how many tokens the model can consider at once: GPT-3 handled 2,048 in 2020, while Gemini 1.5 Pro offered one million in 2024. Languages in non-Latin scripts often need more tokens for the same meaning.

What text-only still means

Many models remain text-only, especially smaller ones and older families such as GPT-3, Llama 2 and BERT, and text still carries most business uses: drafting, summarising, pulling fields out of documents, translation and search. Text-only models are cheaper to train and serve, and easier to evaluate, since their inputs and outputs can be checked and compared directly.

Famous text models

Further reading

Jais 🇦🇪 United Arab EmiratesJais An open Arabic and English large language model from the UAEGeneral · Open weights · 2023 Amália 🇵🇹 PortugalAmália A Portuguese language model for public administration.Regional · API only · 2024 Minerva 🇮🇹 ItalyMinerva An Italian-first large language model trained from scratch at Sapienza University of Rome.General · Open weights · 2024 Apertus 🇨🇭 SwitzerlandApertus A Swiss public large language model released in 8B and 70B sizesGeneral · Open weights · 2025 Gemini Embedding 🇺🇸 United StatesGemini Embedding Google's embedding model built from Gemini for text, code and many languagesEncoder · API only · 2025 MT5 🇺🇸 United StatesMT5 A multilingual text-to-text transformer pretrained on 101 languagesGeneral · Open weights · 2020 MuRIL 🇮🇳 IndiaMuRIL A BERT-style encoder pre-trained on 17 Indian languages and their transliterationsEncoder · Open weights · 2021 XLM-RoBERTa 🇺🇸 United StatesXLM-RoBERTa A multilingual masked language model covering 100 languages, built on RoBERTa.General · Open weights · 2019 AceGPT 🇨🇳 ChinaAceGPT An Arabic-focused large language model designed for cultural alignment and local values.Regional · Fully open · 2023 Project Indus 🇮🇳 IndiaProject Indus Open-source language model for Hindi and dialectsGeneral · Open weights Swallow 🇯🇵 JapanSwallow Japanese-enhanced Llama models by Tokyo TechGeneral · Open weights · 2024 Sarashina2 🇯🇵 JapanSarashina2 Open-weight Japanese and English language models by SB IntuitionsGeneral · Open weights SEA-LION 🇸🇬 SingaporeSEA-LION Multilingual language models for Southeast AsiaGeneral · Open weights · 2025 RakutenAI-7B 🇯🇵 JapanRakutenAI-7B Japanese-focused open language model based on MistralGeneral · Open weights · 2024 PLLuM 🇵🇱 PolandPLLuM Polish-focused large language model familyGeneral · Open weights · 2024 Mistral Saba 🇫🇷 FranceMistral Saba A 24B regional language model for Arabic and South Asian languagesRegional · API only · 2025 IndicTrans2 🇮🇳 IndiaIndicTrans2 Machine translation for 22 scheduled Indian languagesDomain · Open weights · 2023 IndicBERT 🇮🇳 IndiaIndicBERT Multilingual encoder model for Indian languagesEncoder · Open weights · 2022 IndicBART 🇮🇳 IndiaIndicBART Sequence-to-sequence model for Indic languagesRegional · Open weights · 2021 Tamil-LLaMA WorldTamil-LLaMA Open Tamil language model based on LLaMA 2Regional · Open weights · 2023 OpenHathi 🇮🇳 IndiaOpenHathi A 7 billion parameter language model for Hindi and English.General · Open weights Ganga-1B 🇮🇳 IndiaGanga-1B Hindi-focused autoregressive language model from IIT GandhinagarRegional · Open weights Teuken-7B 🇩🇪 GermanyTeuken-7B Multilingual LLM for all 24 official EU languagesGeneral · Open weights · 2024 ALIA-40b 🇪🇸 SpainALIA-40b Multilingual base model for 35 European languagesGeneral · Open weights PhoGPT 🇻🇳 VietnamPhoGPT Open-source generative model for Vietnamese language tasks.General · Open weights · 2023 Lucie-7B 🇫🇷 FranceLucie-7B Open multilingual language model focused on French and EnglishGeneral · Open weights · 2025 CroissantLLM 🇫🇷 FranceCroissantLLM A 1.3 billion parameter bilingual French-English language model.General · Open weights · 2024 Bielik 🇵🇱 PolandBielik Polish-optimised 11 billion parameter language modelGeneral · Open weights · 2025 CamemBERT 🇫🇷 FranceCamemBERT French language model based on RoBERTa architectureEncoder · Open weights · 2019 PLaMo-100B 🇯🇵 JapanPLaMo-100B A 100-billion parameter language model built for Japanese.General · Open weights · 2024 SeaLLMs 🇸🇬 SingaporeSeaLLMs Open language models for Southeast Asian languagesGeneral · Open weights · 2023 MaLLaM 🇲🇾 MalaysiaMaLLaM Large language models trained on Malaysian context and Malay language data.General · Open weights · 2024 Taiwan-LLM 🇹🇼 TaiwanTaiwan-LLM Open language model for Traditional Chinese in TaiwanRegional · Fully open · 2023 PLaMo 2 🇯🇵 JapanPLaMo 2 Japanese-focused large language model series by Preferred NetworksGeneral · Open weights · 2025 RuGPT-3 🇷🇺 RussiaRuGPT-3 Russian language model based on GPT-2 architectureRegional · Open weights HyperCLOVA X 🇰🇷 South KoreaHyperCLOVA X Korean-focused large language model with English and coding skillsGeneral · Research only · 2024 EXAONE 3.0 🇰🇷 South KoreaEXAONE 3.0 Open bilingual language model from LG AI ResearchGeneral · Open weights · 2024 PanGu-Alpha 🇨🇳 ChinaPanGu-Alpha A large Chinese language model with 200 billion parameters.General · Research only · 2021 EuroLLM WorldEuroLLM Open multilingual models for European languagesGeneral · Open weights · 2024 imgwavfnFanar 🇶🇦 QatarFanar Arabic-centric multimodal generative AI platform and modelsMultimodal · API only · 2025 Sherkala-Chat 🇰🇿 KazakhstanSherkala-Chat Open LLM for Kazakh language tasksRegional · Open weights · 2025 LLM-jp-3 🇯🇵 JapanLLM-jp-3 Open Japanese language model family by NIIGeneral · Open weights · 2024 Llama-3-ELYZA-JP-8B 🇯🇵 JapanLlama-3-ELYZA-JP-8B Japanese-tuned Llama 3 model by ELYZAGeneral · Conditional licence Stockmark-100b 🇯🇵 JapanStockmark-100b A 100 billion parameter Japanese and English language model.General · Open weights Navarasa 2.0 🇮🇳 IndiaNavarasa 2.0 Instruction-tuned model for 15 Indian languages and English.Regional · Open weights wavShuka v1 🇮🇳 IndiaShuka v1 Audio-native language model for Indic languagesMultimodal · Open weights Sarvam-1 🇮🇳 IndiaSarvam-1 A 2-billion parameter language model for Indian languages.Regional · Conditional licence · 2024 Krutrim-1 🇮🇳 IndiaKrutrim-1 Multilingual language model for Indian languagesGeneral · Conditional licence · 2024

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.