Large: 70 to 300 billion
Llama 3 70B, GPT-3, Falcon 180B and the larger open releases. 69 models.
馃嚞馃嚙 United KingdomChinchilla
A 70-billion-parameter DeepMind model built to test how models should scale.Research 路 Research only 路 2022
WorldLaMDA
Google's conversational language model family, first shown in 2021General 路 API only 路 2020
馃嚚馃嚦 ChinaPanGu-Alpha
A large Chinese language model with 200 billion parameters.General 路 Research only 路 2021
馃嚚馃嚦 ChinaERNIE 3.0 Titan
Large-scale Chinese knowledge-enhanced pre-trained language modelGeneral 路 Research only 路 2021
馃嚭馃嚫 United StatesOPT
Meta AI's family of open decoder-only language models from 125M to 175B parametersGeneral 路 Conditional licence 路 2022
馃嚭馃嚫 United StatesWebGPT
A GPT-3 model fine-tuned to answer questions while browsing the webGeneral 路 Research only 路 2021
馃嚢馃嚪 South KoreaHyperCLOVA
Korean language model with 82 billion parametersGeneral 路 Research only 路 2021
馃嚞馃嚙 United KingdomGopher
A 280 billion parameter Transformer language model from DeepMind, studied for how scale changes ability.Research 路 Research only 路 2021