Compact: 1 to 10 billion
Phi, Gemma, Llama 3 8B, Mistral 7B and most on-device and edge models. 82 models.
WorldGPT-J
A 6-billion-parameter open English text generator from EleutherAI, released in 2021.General · Open weights · 2021
World1.58-bit large language model
A model whose weights hold only three values: -1, 0 and +1.Research · Open weights · 2024
🇺🇸 United StatesGPT-2
OpenAI's 2019 text model that predicts the next word in a sequenceGeneral · Open weights · 2019
🇺🇸 United StatesRecurrentGemma
Open language models using Google's Griffin recurrent-plus-attention architectureGeneral · Open weights · 2024
🇺🇸 United StatesDeBERTa
A BERT-style encoder with disentangled attention and an enhanced mask decoder.Encoder · Open weights · 2020
🇮🇳 IndiaGanga-1B
Hindi-focused autoregressive language model from IIT GandhinagarRegional · Open weights
WorldLLaDA
An 8-billion parameter diffusion language modelGeneral · Open weights · 2025
🇺🇸 United StatesOpenELM
Apple's small open language models with a full training and inference releaseSmall · Open weights · 2024
🇺🇸 United StatesPhi-2
A 2.7 billion parameter Microsoft research model for QA, chat and codeResearch · Open weights