All models
471 models so far, best known first. 21 more are on the list to be written.
WorldMM1
A family of multimodal language models up to 30B parameters, dense and MoE.Multimodal · Research only · 2024
WorldSwitch Transformer
A sparse mixture-of-experts language model scaling to a trillion parameters.Research · Research only · 2021
🇺🇸 United StatesGLaM
A trillion-parameter mixture-of-experts language model from Google ResearchResearch · Research only · 2021
🇺🇸 United StatesNLLB-200
A research translation model covering 200 languages, built for low-resource ones.General · Conditional licence · 2022
🇨🇳 ChinaDeepSeekMoE
Mixture-of-experts language model architecture by DeepSeek AIGeneral · Open weights · 2024
🇨🇳 ChinaPanGu-Sigma
Trillion-parameter sparse language model for Chinese NLP tasksGeneral · Research only · 2023