Very large: 300 billion to 1 trillion
PaLM, Llama 3.1 405B, DeepSeek-V3 and the big mixture-of-experts models. 37 models.
馃嚚馃嚦 ChinaDeepSeek-V3
Open-weight mixture of experts language model with 671 billion parameters.General 路 Open weights 路 2024
WorldMiniMax-M3
Native multimodal model with 1M context and sparse attentionMultimodal 路 Open weights
馃嚚馃嚦 ChinaMiMo-V2-Flash
High-speed MoE language model for reasoning and agentsGeneral 路 Open weights
馃嚭馃嚫 United StatesTrinity Large
398B-parameter sparse MoE model family by Arcee AIGeneral 路 Open weights 路 2026
馃嚚馃嚦 ChinaDeepSeek-V3.1
Hybrid thinking and non-thinking language model with 671 billion parameters.General 路 Open weights
馃嚚馃嚦 ChinaDeepSeek-Prover-V2
Open-source model for formal theorem proving in Lean 4Reasoning 路 Open weights 路 2025
馃嚢馃嚪 South KoreaK-EXAONE 2.0
Open-weight multilingual language model by LG AI ResearchGeneral 路 Open weights
馃嚢馃嚪 South KoreaA.X K1
Sparse MoE model with controllable reasoning depthGeneral 路 Open weights 路 2026
馃嚚馃嚦 ChinaGLM-4.5
Open-source mixture of experts model for agents and reasoningGeneral 路 Open weights 路 2025
馃嚚馃嚦 ChinaMiniMax-M1
Open-weight reasoning model with hybrid attention and long contextReasoning 路 Open weights 路 2025
馃嚚馃嚦 ChinaGLM-5
Open-weight model for engineering and agentic tasksGeneral 路 Open weights 路 2026
馃嚚馃嚦 ChinaHunyuan-TurboS
Hybrid Mamba-Transformer MoE model by TencentGeneral 路 API only 路 2025
馃嚚馃嚦 ChinaStep3
Multimodal reasoning model with 321 billion parametersMultimodal 路 Open weights 路 2025