Search: Mixture of experts
Concepts
🇺🇸 United StatesMuse
Meta's multimodal LLM family, successor to Llama, with open and closed variantsGeneral · API only · 2026
WorldMamba
Efficient sequence modelling architecture using state spacesResearch · Open weights
WorldInkling
An open-weights mixture-of-experts model handling text, images and audio inputGeneral · Open weights · 2026
🇨🇳 ChinaWu Dao
BAAI's trillion-parameter multimodal model family, announced 2021Multimodal · Research only · 2021
🇺🇸 United StatesGemini
Google DeepMind's multimodal LLM family, from Nano to UltraGeneral · API only · 2023
🇨🇳 ChinaQwen
A family of large and small language models developed by Alibaba Cloud.General · Open weights · 2023
🇺🇸 United StatesLlama
Meta AI's family of open-weight language models, from 1B to 2T parametersGeneral · Conditional licence · 2023
🇷🇺 RussiaAlice AI
Yandex's family of language, vision and image models behind the Alice assistantGeneral · API only · 2023
🇨🇳 ChinaHuawei PanGu
Huawei's multimodal large model family for industry, from 1B to trillion-scaleMultimodal · Open weights · 2023
WorldDBRX
A 132-billion-parameter mixture-of-experts language model from Databricks.General · Conditional licence · 2024
🇺🇸 United StatesGemma 4
Google DeepMind's open multimodal models in five sizes, from phones to serversGeneral · Open weights
WorldSwitch Transformer
A sparse mixture-of-experts language model scaling to a trillion parameters.Research · Research only · 2021
🇺🇸 United StatesGLaM
A trillion-parameter mixture-of-experts language model from Google ResearchResearch · Research only · 2021
🇺🇸 United StatesNLLB-200
A research translation model covering 200 languages, built for low-resource ones.General · Conditional licence · 2022
🇺🇸 United StatesPhi-3
Small Microsoft language models built to run well on phones and laptops.Small · Open weights · 2024
🇨🇳 ChinaDeepSeek-V3
Open-weight mixture of experts language model with 671 billion parameters.General · Open weights · 2024
🇨🇳 ChinaQwen2.5-Max
Large-scale mixture of experts model by Alibaba CloudGeneral · API only · 2025
🇨🇳 ChinaQwen3-Omni
Multimodal model processing text, audio, video and images with real-time speech output.Multimodal · Open weights · 2025
🇨🇳 ChinaKimi K2 Thinking
Open-source reasoning model with tool use and INT4 quantizationReasoning · Open weights
WorldMiniMax-M3
Native multimodal model with 1M context and sparse attentionMultimodal · Open weights
🇨🇳 ChinaERNIE 5.5 Flash
Efficient sparse MoE language model with 280B total parametersGeneral · Open weights
WorldSeed1.5-VL
Multimodal vision-language model with reasoning capabilitiesMultimodal · API only · 2025
🇨🇳 ChinaMiMo-V2-Flash
High-speed MoE language model for reasoning and agentsGeneral · Open weights
🇺🇸 United StatesSnowflake Arctic
Open enterprise language model with hybrid MoE designGeneral · Open weights · 2024
🇫🇷 FranceLeanstral 1.5
An open code agent model built for the Lean 4 proof assistantCode · Open weights
🇺🇸 United StatesNorth Mini Code
A 30B sparse mixture-of-experts model for code and terminal agent workCode · Conditional licence
🇺🇸 United StatesGranite 4.0
IBM's hybrid Mamba/transformer language models for enterprise workGeneral · Open weights · 2025
🇫🇷 FranceMistral Large 3
A 675B-parameter open-weight mixture-of-experts multimodal model from Mistral AIGeneral · Open weights
WorldMM1
A family of multimodal language models up to 30B parameters, dense and MoE.Multimodal · Research only · 2024
🇺🇸 United StatesApple Foundation Models
Apple's 2025 on-device and server language models for Apple IntelligenceGeneral · API only · 2025
🇫🇷 FranceMixtral 8x22B
Sparse mixture-of-experts open model with 39B active parameters out of 141BGeneral · Open weights
🇺🇸 United StatesGpt-oss-120b
OpenAI's open-weight reasoning model that fits on one 80GB GPUReasoning · Open weights · 2025
🇺🇸 United StatesGpt-oss-20b
OpenAI's smaller open-weight reasoning model for local and low-latency useReasoning · Open weights · 2025
🇺🇸 United StatesGemini 1.5 Pro
Google DeepMind's mid-size multimodal model with up to a 1 million token context windowGeneral · API only · 2024
🇺🇸 United StatesGranite 3.0
IBM's third-generation open enterprise language models, from 2B to 8B parametersGeneral · Open weights · 2024
🇫🇷 FranceMixtral 8x7B
Sparse mixture-of-experts language model with open weightsGeneral · Open weights · 2023
🇺🇸 United StatesNemotron 3 Super
NVIDIA's 120B hybrid MoE language model with 12B active parameters and 1M-token contextGeneral · Conditional licence · 2026
🇮🇳 IndiaParam-2-17B
Multilingual MoE model for Indian languages and reasoningGeneral · Open weights
🇨🇳 ChinaDeepSeekMoE
Mixture-of-experts language model architecture by DeepSeek AIGeneral · Open weights · 2024
WorldSUTRA
Multilingual model separating concepts from language processingGeneral · Research only · 2024
🇨🇳 ChinaDeepSeek-Coder-V2
Open-source mixture-of-experts model for code and mathCode · Open weights · 2024
🇨🇳 ChinaDeepSeek-VL2
Mixture-of-experts vision-language model series for multimodal tasksMultimodal · Open weights · 2024
WorldINTELLECT-3
Open 106B MoE reasoning model from Prime IntellectReasoning · Open weights
🇺🇸 United StatesTrinity Large
398B-parameter sparse MoE model family by Arcee AIGeneral · Open weights · 2026
🇨🇳 ChinaDeepSeek-V3.1
Hybrid thinking and non-thinking language model with 671 billion parameters.General · Open weights
🇨🇳 ChinaDeepSeek-V4-Pro
1.6T parameter MoE model with one million token contextGeneral · Open weights · 2026
🇨🇳 ChinaDeepSeek-V4-Flash
Efficient mixture-of-experts model with one million token contextGeneral · Open weights · 2026
🇨🇳 ChinaDeepSeek-V4.1-Flash
Multimodal MoE model with efficient KV cache compressionMultimodal · Open weights
🇨🇳 ChinaQwen1.5
Open-weight language model series with nine sizes and strong multilingual support.General · Open weights · 2024
🇰🇷 South KoreaK-EXAONE 2.0
Open-weight multilingual language model by LG AI ResearchGeneral · Open weights
🇨🇳 ChinaQwen3-235B-A22B
Mixture-of-experts model with switchable reasoning modesGeneral · Open weights · 2025
🇰🇷 South KoreaA.X K1
Sparse MoE model with controllable reasoning depthGeneral · Open weights · 2026
🇨🇳 ChinaQwen3-Coder
Agentic coding model with 480 billion parametersCode · Open weights · 2025
🇨🇳 ChinaQwen3-Next-80B-A3B
An 80-billion parameter hybrid model with ultra-long context support.General · Open weights
🇨🇳 ChinaQwen3-VL
Vision-language model with deep visual reasoning and long video context.Multimodal · Open weights
🇨🇳 ChinaQwen3.5-397B-A17B
A large multimodal language model with sparse activation.General · Open weights
🇨🇳 ChinaQwen3.6-35B-A3B
Open-weight multimodal coding model with hybrid architectureCode · Open weights · 2026
🇰🇷 South KoreaSolar Open 100B
102B parameter Mixture-of-Experts model by UpstageGeneral · Conditional licence · 2026
🇰🇷 South KoreaSolar Open 2
250B parameter open-weight model for agentic tasksGeneral · Open weights · 2026
🇰🇷 South KoreaKanana-2
Open-source multilingual model for agentic AI and reasoning.General · Open weights