Very large: 300 billion to 1 trillion
PaLM, Llama 3.1 405B, DeepSeek-V3 and the big mixture-of-experts models. 37 models.
WorldMiniMax-M3
Native multimodal model with 1M context and sparse attentionMultimodal 路 Open weights
馃嚭馃嚫 United StatesTrinity Large
398B-parameter sparse MoE model family by Arcee AIGeneral 路 Open weights 路 2026
馃嚚馃嚦 ChinaGLM-5
Open-weight model for engineering and agentic tasksGeneral 路 Open weights 路 2026
馃嚚馃嚦 ChinaHunyuan-TurboS
Hybrid Mamba-Transformer MoE model by TencentGeneral 路 API only 路 2025