News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Search: sparse

Concepts

fnNorth Mini Code 🇺🇸 United StatesNorth Mini Code A 30B sparse mixture-of-experts model for code and terminal agent workCode · Conditional licence Mixtral 8x22B 🇫🇷 FranceMixtral 8x22B Sparse mixture-of-experts open model with 39B active parameters out of 141BGeneral · Open weights Switch Transformer WorldSwitch Transformer A sparse mixture-of-experts language model scaling to a trillion parameters.Research · Research only · 2021 GLaM 🇺🇸 United StatesGLaM A trillion-parameter mixture-of-experts language model from Google ResearchResearch · Research only · 2021 imgvidMiniMax-M3 WorldMiniMax-M3 Native multimodal model with 1M context and sparse attentionMultimodal · Open weights ERNIE 5.5 Flash 🇨🇳 ChinaERNIE 5.5 Flash Efficient sparse MoE language model with 280B total parametersGeneral · Open weights Mixtral 8x7B 🇫🇷 FranceMixtral 8x7B Sparse mixture-of-experts language model with open weightsGeneral · Open weights · 2023 fnTrinity Large 🇺🇸 United StatesTrinity Large 398B-parameter sparse MoE model family by Arcee AIGeneral · Open weights · 2026 fnDeepSeek-V3.2 🇨🇳 ChinaDeepSeek-V3.2 Efficient reasoning and agentic AI model with sparse attentionReasoning · Open weights · 2025 A.X K1 🇰🇷 South KoreaA.X K1 Sparse MoE model with controllable reasoning depthGeneral · Open weights · 2026 imgfnQwen3.5-397B-A17B 🇨🇳 ChinaQwen3.5-397B-A17B A large multimodal language model with sparse activation.General · Open weights imgfnKimi K3.1 Pro 🇨🇳 ChinaKimi K3.1 Pro Open-weight multimodal agentic model with 1M token contextMultimodal · Open weights fnLongCat-2.0 🇨🇳 ChinaLongCat-2.0 A 1.6 trillion parameter MoE language model from Meituan.General · Open weights PanGu-Sigma 🇨🇳 ChinaPanGu-Sigma Trillion-parameter sparse language model for Chinese NLP tasksGeneral · Research only · 2023 Pangu Ultra 🇨🇳 ChinaPangu Ultra A 135-billion parameter dense language model trained on Ascend hardware.General · API only · 2025 fnStep-3.5-Flash 🇨🇳 ChinaStep-3.5-Flash Open-source MoE model for reasoning and agentsGeneral · Open weights · 2026 OLMoE 🇺🇸 United StatesOLMoE Open mixture-of-experts language model with 1 billion active parametersGeneral · Fully open · 2024 imgvidfnStep-5-Preview WorldStep-5-Preview Agentic model with 600B parameters and 1M token contextGeneral · Open weights · 2026

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.