All models
471 models so far, best known first. 21 more are on the list to be written.
WorldXLNet
Permutation-based autoregressive transformer model created by Google AIResearch · Open weights · 2019
WorldGPT-J
A 6-billion-parameter open English text generator from EleutherAI, released in 2021.General · Open weights · 2021
World1.58-bit large language model
A model whose weights hold only three values: -1, 0 and +1.Research · Open weights · 2024
WorldGPT-1
OpenAI's first GPT model, a 117M-parameter decoder-only transformer from 2018.Research · Open weights · 2018
🇺🇸 United StatesGPT-2
OpenAI's 2019 text model that predicts the next word in a sequenceGeneral · Open weights · 2019
🇺🇸 United StatesTalkie
A 13B small language model trained only on pre-1931 public domain English textSmall · Open weights · 2026
WorldINTELLECT-1
A 10 billion parameter model trained by a global community.General · Open weights · 2024
🇺🇸 United StatesOpenELM
Apple's small open language models with a full training and inference releaseSmall · Open weights · 2024
🇺🇸 United StatesDialoGPT
A GPT-style model trained on Reddit threads to write chat repliesGeneral · Open weights · 2019
🇺🇸 United StatesBioGPT
A generative Transformer trained on biomedical writing for text and mining tasksDomain · Open weights · 2022
🇮🇳 IndiaGanga-1B
Hindi-focused autoregressive language model from IIT GandhinagarRegional · Open weights
🇺🇸 United StatesCerebras-GPT
Open compute-optimal language models from Cerebras SystemsGeneral · Open weights · 2023
🇺🇸 United StatesGPT-NeoX-20B
Open 20 billion parameter autoregressive language model by EleutherAIGeneral · Open weights · 2022
🇺🇸 United StatesTülu 3
Open post-trained model family built on Llama 3.1General · Open weights · 2024
🇷🇺 RussiaRuGPT-3
Russian language model based on GPT-2 architectureRegional · Open weights
🇨🇳 ChinaCogVLM
Open-source visual language model with deep feature fusionMultimodal · Open weights · 2023
🇺🇸 United StatesPhi-2
A 2.7 billion parameter Microsoft research model for QA, chat and codeResearch · Open weights
🇺🇸 United StatesPythia
A suite of 16 models for interpretability research.Research · Open weights · 2023
WorldULMFiT
Transfer learning method for NLP text classification tasksResearch · Open weights · 2018