News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Search: moe

Concepts

OLMoE 🇺🇸 United StatesOLMoE Open mixture-of-experts language model with 1 billion active parametersGeneral · Fully open · 2024 DeepSeekMoE 🇨🇳 ChinaDeepSeekMoE Mixture-of-experts language model architecture by DeepSeek AIGeneral · Open weights · 2024 MiMo-V2-Flash 🇨🇳 ChinaMiMo-V2-Flash High-speed MoE language model for reasoning and agentsGeneral · Open weights Snowflake Arctic 🇺🇸 United StatesSnowflake Arctic Open enterprise language model with hybrid MoE designGeneral · Open weights · 2024 fnNemotron 3 Super 🇺🇸 United StatesNemotron 3 Super NVIDIA's 120B hybrid MoE language model with 12B active parameters and 1M-token contextGeneral · Conditional licence · 2026 fnParam-2-17B 🇮🇳 IndiaParam-2-17B Multilingual MoE model for Indian languages and reasoningGeneral · Open weights INTELLECT-3 WorldINTELLECT-3 Open 106B MoE reasoning model from Prime IntellectReasoning · Open weights fnTrinity Large 🇺🇸 United StatesTrinity Large 398B-parameter sparse MoE model family by Arcee AIGeneral · Open weights · 2026 fnDeepSeek-V4-Pro 🇨🇳 ChinaDeepSeek-V4-Pro 1.6T parameter MoE model with one million token contextGeneral · Open weights · 2026 imgDeepSeek-V4.1-Flash 🇨🇳 ChinaDeepSeek-V4.1-Flash Multimodal MoE model with efficient KV cache compressionMultimodal · Open weights A.X K1 🇰🇷 South KoreaA.X K1 Sparse MoE model with controllable reasoning depthGeneral · Open weights · 2026 MiniCPM 🇨🇳 ChinaMiniCPM Efficient small language models for end-side devicesGeneral · Open weights · 2024 imgLongCat-2.5 🇨🇳 ChinaLongCat-2.5 Multimodal MoE model for long-horizon agentic tasksMultimodal · Open weights fnLongCat-2.0 🇨🇳 ChinaLongCat-2.0 A 1.6 trillion parameter MoE language model from Meituan.General · Open weights wavfnSarvam-30B 🇮🇳 IndiaSarvam-30B Open-weight MoE model for Indian languages and codingGeneral · Open weights fnLongCat-Flash 🇨🇳 ChinaLongCat-Flash Efficient 560B parameter MoE model for agentic tasksGeneral · Open weights · 2025 fnHunyuan-A13B 🇨🇳 ChinaHunyuan-A13B Open-source MoE language model with 80 billion total parametersGeneral · Open weights · 2025 Hunyuan-TurboS 🇨🇳 ChinaHunyuan-TurboS Hybrid Mamba-Transformer MoE model by TencentGeneral · API only · 2025 MiMo-V2.5-Pro 🇨🇳 ChinaMiMo-V2.5-Pro Open-source MoE language model with 1M token contextGeneral · Open weights fnStep-3.5-Flash 🇨🇳 ChinaStep-3.5-Flash Open-source MoE model for reasoning and agentsGeneral · Open weights · 2026 Sarvam-105B 🇮🇳 IndiaSarvam-105B Open-weight MoE model for Indian languages and reasoningGeneral · Open weights Hunyuan-Large 🇨🇳 ChinaHunyuan-Large Open-source mixture of experts model with 389 billion parametersGeneral · Open weights · 2024 Param-1 🇮🇳 IndiaParam-1 Bilingual and multilingual language models from India.General · Conditional licence fnMiniMax-M2 🇨🇳 ChinaMiniMax-M2 Open-source MoE model for coding and agentsCode · Open weights fnNemotron 3 Nano 🇺🇸 United StatesNemotron 3 Nano NVIDIA's 30B hybrid Mamba-Transformer MoE model for reasoning and agentsGeneral · Conditional licence · 2025 imgMM1 WorldMM1 A family of multimodal language models up to 30B parameters, dense and MoE.Multimodal · Research only · 2024 imgvidfnStep-5-Preview WorldStep-5-Preview Agentic model with 600B parameters and 1M token contextGeneral · Open weights · 2026 ERNIE 5.5 Flash 🇨🇳 ChinaERNIE 5.5 Flash Efficient sparse MoE language model with 280B total parametersGeneral · Open weights

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.