Search: sparse
Concepts
🇺🇸 United StatesNorth Mini Code
A 30B sparse mixture-of-experts model for code and terminal agent workCode · Conditional licence
🇫🇷 FranceMixtral 8x22B
Sparse mixture-of-experts open model with 39B active parameters out of 141BGeneral · Open weights
WorldSwitch Transformer
A sparse mixture-of-experts language model scaling to a trillion parameters.Research · Research only · 2021
🇺🇸 United StatesGLaM
A trillion-parameter mixture-of-experts language model from Google ResearchResearch · Research only · 2021
WorldMiniMax-M3
Native multimodal model with 1M context and sparse attentionMultimodal · Open weights
🇨🇳 ChinaERNIE 5.5 Flash
Efficient sparse MoE language model with 280B total parametersGeneral · Open weights
🇫🇷 FranceMixtral 8x7B
Sparse mixture-of-experts language model with open weightsGeneral · Open weights · 2023
🇺🇸 United StatesTrinity Large
398B-parameter sparse MoE model family by Arcee AIGeneral · Open weights · 2026
🇨🇳 ChinaDeepSeek-V3.2
Efficient reasoning and agentic AI model with sparse attentionReasoning · Open weights · 2025
🇰🇷 South KoreaA.X K1
Sparse MoE model with controllable reasoning depthGeneral · Open weights · 2026
🇨🇳 ChinaQwen3.5-397B-A17B
A large multimodal language model with sparse activation.General · Open weights
🇨🇳 ChinaKimi K3.1 Pro
Open-weight multimodal agentic model with 1M token contextMultimodal · Open weights
🇨🇳 ChinaLongCat-2.0
A 1.6 trillion parameter MoE language model from Meituan.General · Open weights
🇨🇳 ChinaPanGu-Sigma
Trillion-parameter sparse language model for Chinese NLP tasksGeneral · Research only · 2023
🇨🇳 ChinaPangu Ultra
A 135-billion parameter dense language model trained on Ascend hardware.General · API only · 2025
🇨🇳 ChinaStep-3.5-Flash
Open-source MoE model for reasoning and agentsGeneral · Open weights · 2026
🇺🇸 United StatesOLMoE
Open mixture-of-experts language model with 1 billion active parametersGeneral · Fully open · 2024
WorldStep-5-Preview
Agentic model with 600B parameters and 1M token contextGeneral · Open weights · 2026