Search: hybrid attention
馃嚢馃嚪 South KoreaEXAONE 4.0
Unified language model with reasoning and non-reasoning modesGeneral 路 Conditional licence 路 2025
馃嚚馃嚦 ChinaERNIE 5.5 Flash
Efficient sparse MoE language model with 280B total parametersGeneral 路 Open weights
馃嚚馃嚦 ChinaMiMo-V2-Flash
High-speed MoE language model for reasoning and agentsGeneral 路 Open weights
馃嚚馃嚦 ChinaQwen3-Next-80B-A3B
An 80-billion parameter hybrid model with ultra-long context support.General 路 Open weights
馃嚚馃嚦 ChinaMiniMax-M1
Open-weight reasoning model with hybrid attention and long contextReasoning 路 Open weights 路 2025
馃嚚馃嚦 ChinaMiMo-V2.5-Pro
Open-source MoE language model with 1M token contextGeneral 路 Open weights