Search: 2021
🇨🇳 ChinaWu Dao
BAAI's trillion-parameter multimodal model family, announced 2021Multimodal · Research only · 2021
WorldGPT-J
A 6-billion-parameter open English text generator from EleutherAI, released in 2021.General · Open weights · 2021
🇺🇸 United StatesOpenAI Codex
A code-writing language model fine-tuned from GPT-3Code · API only · 2025
🇯🇵 Japan and 1 moreBuddhaBot
A chatbot answering questions from early Buddhist textsDomain · Research only · 2021
🇺🇸 United StatesCharacter.ai
A chatbot service where users talk to custom-made charactersAssistant · API only · 2022
🇨🇳 ChinaGLM
Open-weight Chinese model series used for chat and codingGeneral · Open weights · 2021
WorldLaMDA
Google's conversational language model family, first shown in 2021General · API only · 2020
🇺🇸 United StatesDALL-E
Text-to-image model series by OpenAIMultimodal · API only · 2021
🇨🇳 ChinaERNIE 3.0 Titan
Large-scale Chinese knowledge-enhanced pre-trained language modelGeneral · Research only · 2021
WorldRETRO
A retrieval-enhanced transformer that conditions on chunks from a huge document database.Research · Research only · 2021
🇰🇷 South KoreaHyperCLOVA
Korean language model with 82 billion parametersGeneral · Research only · 2021
🇮🇳 IndiaIndicBART
Sequence-to-sequence model for Indic languagesRegional · Open weights · 2021
🇨🇳 ChinaPanGu-Alpha
A large Chinese language model with 200 billion parameters.General · Research only · 2021
🇨🇳 ChinaERNIE 3.0
Knowledge-enhanced pre-training model for language tasksGeneral · Research only · 2021
🇺🇸 United StatesWebGPT
A GPT-3 model fine-tuned to answer questions while browsing the webGeneral · Research only · 2021
WorldSwitch Transformer
A sparse mixture-of-experts language model scaling to a trillion parameters.Research · Research only · 2021
🇺🇸 United StatesGLaM
A trillion-parameter mixture-of-experts language model from Google ResearchResearch · Research only · 2021
🇮🇳 IndiaMuRIL
A BERT-style encoder pre-trained on 17 Indian languages and their transliterationsEncoder · Open weights · 2021
🇫🇷 FranceT0
Encoder-decoder model for zero-shot task generalisation via promptsGeneral · Open weights · 2021
🇬🇧 United KingdomGopher
A 280 billion parameter Transformer language model from DeepMind, studied for how scale changes ability.Research · Research only · 2021