Very large: 300 billion to 1 trillion
PaLM, Llama 3.1 405B, DeepSeek-V3 and the big mixture-of-experts models. 37 models.
馃嚚馃嚦 ChinaMiMo-V2-Flash
High-speed MoE language model for reasoning and agentsGeneral 路 Open weights
馃嚚馃嚦 ChinaMiniMax-M1
Open-weight reasoning model with hybrid attention and long contextReasoning 路 Open weights 路 2025
馃嚚馃嚦 ChinaHunyuan-TurboS
Hybrid Mamba-Transformer MoE model by TencentGeneral 路 API only 路 2025