Trillion-scale: 1 trillion and more
Kimi K2, the Switch Transformer and the largest models whose size is published. 19 models.
馃嚚馃嚦 ChinaWu Dao
BAAI's trillion-parameter multimodal model family, announced 2021Multimodal 路 Research only 路 2021
馃嚭馃嚫 United StatesClaude Mythos
Anthropic's restricted model family for finding software security flawsDomain 路 Research only 路 2026
馃嚭馃嚫 United StatesLlama
Meta AI's family of open-weight language models, from 1B to 2T parametersGeneral 路 Conditional licence 路 2023
馃嚭馃嚫 United StatesGLaM
A trillion-parameter mixture-of-experts language model from Google ResearchResearch 路 Research only 路 2021
馃嚚馃嚦 ChinaPanGu-Sigma
Trillion-parameter sparse language model for Chinese NLP tasksGeneral 路 Research only 路 2023