Very large: 300 billion to 1 trillion
PaLM, Llama 3.1 405B, DeepSeek-V3 and the big mixture-of-experts models. 37 models.
馃嚚馃嚦 ChinaMiMo-V2-Flash
High-speed MoE language model for reasoning and agentsGeneral 路 Open weights
馃嚭馃嚫 United StatesSnowflake Arctic
Open enterprise language model with hybrid MoE designGeneral 路 Open weights 路 2024
馃嚚馃嚦 ChinaQwen3.5-397B-A17B
A large multimodal language model with sparse activation.General 路 Open weights
馃嚚馃嚦 ChinaMiniMax-Text-01
A large language model with a four million token context window.General 路 Open weights 路 2025
馃嚚馃嚦 ChinaMiniMax-M1
Open-weight reasoning model with hybrid attention and long contextReasoning 路 Open weights 路 2025