Large: 70 to 300 billion
Llama 3 70B, GPT-3, Falcon 180B and the larger open releases. 69 models.
WorldLaMDA
Google's conversational language model family, first shown in 2021General · API only · 2020
🇬🇧 United KingdomChinchilla
A 70-billion-parameter DeepMind model built to test how models should scale.Research · Research only · 2022
🇬🇧 United KingdomSparrow
DeepMind's rule-following English chatbot that cites web evidence for its answersAssistant · Research only · 2022
🇨🇳 ChinaPanGu-Alpha
A large Chinese language model with 200 billion parameters.General · Research only · 2021
🇨🇳 ChinaERNIE 3.0 Titan
Large-scale Chinese knowledge-enhanced pre-trained language modelGeneral · Research only · 2021
🇺🇸 United StatesOPT
Meta AI's family of open decoder-only language models from 125M to 175B parametersGeneral · Conditional licence · 2022
🇰🇷 South KoreaHyperCLOVA
Korean language model with 82 billion parametersGeneral · Research only · 2021
🇺🇸 United StatesWebGPT
A GPT-3 model fine-tuned to answer questions while browsing the webGeneral · Research only · 2021
🇬🇧 United KingdomGopher
A 280 billion parameter Transformer language model from DeepMind, studied for how scale changes ability.Research · Research only · 2021