All models
471 models so far, best known first. 21 more are on the list to be written.
WorldXLNet
Permutation-based autoregressive transformer model created by Google AIResearch · Open weights · 2019
WorldGPT-J
A 6-billion-parameter open English text generator from EleutherAI, released in 2021.General · Open weights · 2021
WorldMamba
Efficient sequence modelling architecture using state spacesResearch · Open weights
World1.58-bit large language model
A model whose weights hold only three values: -1, 0 and +1.Research · Open weights · 2024
WorldBERT
An encoder-only transformer that reads text in both directions at once.Research · Open weights · 2018
WorldGPT-1
OpenAI's first GPT model, a 117M-parameter decoder-only transformer from 2018.Research · Open weights · 2018
🇺🇸 United StatesGPT-2
OpenAI's 2019 text model that predicts the next word in a sequenceGeneral · Open weights · 2019
🇺🇸 United StatesTalkie
A 13B small language model trained only on pre-1931 public domain English textSmall · Open weights · 2026
🇫🇷 FranceT0
Encoder-decoder model for zero-shot task generalisation via promptsGeneral · Open weights · 2021
🇺🇸 United StatesPythia
A suite of 16 models for interpretability research.Research · Open weights · 2023
WorldULMFiT
Transfer learning method for NLP text classification tasksResearch · Open weights · 2018
WorldINTELLECT-1
A 10 billion parameter model trained by a global community.General · Open weights · 2024
🇺🇸 United StatesOpenELM
Apple's small open language models with a full training and inference releaseSmall · Open weights · 2024
🇺🇸 United StatesFlan-T5
Instruction-finetuned T5 checkpoints released by Google for zero-shot and few-shot workGeneral · Open weights · 2022
🇺🇸 United StatesDialoGPT
A GPT-style model trained on Reddit threads to write chat repliesGeneral · Open weights · 2019
🇺🇸 United StatesDeBERTa
A BERT-style encoder with disentangled attention and an enhanced mask decoder.Encoder · Open weights · 2020
🇮🇳 IndiaIndicBART
Sequence-to-sequence model for Indic languagesRegional · Open weights · 2021
🇺🇸 United StatesBioGPT
A generative Transformer trained on biomedical writing for text and mining tasksDomain · Open weights · 2022
🇨🇳 ChinaDeepSeekMoE
Mixture-of-experts language model architecture by DeepSeek AIGeneral · Open weights · 2024
🇮🇳 IndiaGanga-1B
Hindi-focused autoregressive language model from IIT GandhinagarRegional · Open weights
🇺🇸 United StatesCerebras-GPT
Open compute-optimal language models from Cerebras SystemsGeneral · Open weights · 2023
WorldLLaDA
An 8-billion parameter diffusion language modelGeneral · Open weights · 2025
🇺🇸 United StatesGPT-NeoX-20B
Open 20 billion parameter autoregressive language model by EleutherAIGeneral · Open weights · 2022
🇺🇸 United StatesTülu 3
Open post-trained model family built on Llama 3.1General · Open weights · 2024
🇷🇺 RussiaRuGPT-3
Russian language model based on GPT-2 architectureRegional · Open weights
🇺🇸 United StatesPhi-2
A 2.7 billion parameter Microsoft research model for QA, chat and codeResearch · Open weights
🇨🇳 ChinaCogVLM
Open-source visual language model with deep feature fusionMultimodal · Open weights · 2023
🇺🇸 United StatesRecurrentGemma
Open language models using Google's Griffin recurrent-plus-attention architectureGeneral · Open weights · 2024
🇺🇸 United StatesALBERT
A slimmed-down BERT encoder that shares weights across its layersEncoder · Open weights · 2019
🇺🇸 United StatesRoBERTa
A robustly optimised BERT pretraining study with released models and codeEncoder · Open weights · 2019