Search: multi token prediction
🇨🇳 ChinaDeepSeek-V3
Open-weight mixture of experts language model with 671 billion parameters.General · Open weights · 2024
🇨🇳 ChinaMiMo-V2-Flash
High-speed MoE language model for reasoning and agentsGeneral · Open weights
🇺🇸 United StatesNemotron 3 Super
NVIDIA's 120B hybrid MoE language model with 12B active parameters and 1M-token contextGeneral · Conditional licence · 2026
🇰🇷 South KoreaA.X K1
Sparse MoE model with controllable reasoning depthGeneral · Open weights · 2026
🇨🇳 ChinaQwen3-Next-80B-A3B
An 80-billion parameter hybrid model with ultra-long context support.General · Open weights
🇨🇳 ChinaMiMo-V2.5-Pro
Open-source MoE language model with 1M token contextGeneral · Open weights
🇨🇳 ChinaStep-3.5-Flash
Open-source MoE model for reasoning and agentsGeneral · Open weights · 2026
🇰🇷 South KoreaK-EXAONE
LG AI Research multilingual Mixture-of-Experts modelGeneral · Open weights