News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Search: hybrid architecture

Concepts

imgwavvidNemotron 🇺🇸 United StatesNemotron Nvidia family of language and multimodal models for enterprise and reasoningGeneral · Conditional licence · 2023 Snowflake Arctic 🇺🇸 United StatesSnowflake Arctic Open enterprise language model with hybrid MoE designGeneral · Open weights · 2024 fnNemotron Nano 2 🇺🇸 United StatesNemotron Nano 2 A 9B hybrid Mamba-Transformer model for reasoning and chat, from NVIDIA.General · Open weights · 2025 Zamba WorldZamba A 7-billion parameter hybrid language model combining Mamba and transformer layers.General · Open weights · 2024 fnLFM2 🇺🇸 United StatesLFM2 Hybrid language models for edge and on-device useSmall · Open weights PLaMo 2 🇯🇵 JapanPLaMo 2 Japanese-focused large language model series by Preferred NetworksGeneral · Open weights · 2025 fnQwen3-Next-80B-A3B 🇨🇳 ChinaQwen3-Next-80B-A3B An 80-billion parameter hybrid model with ultra-long context support.General · Open weights imgfnQwen3.5-397B-A17B 🇨🇳 ChinaQwen3.5-397B-A17B A large multimodal language model with sparse activation.General · Open weights imgfnQwen3.6-35B-A3B 🇨🇳 ChinaQwen3.6-35B-A3B Open-weight multimodal coding model with hybrid architectureCode · Open weights · 2026 fnSolar Open 2 🇰🇷 South KoreaSolar Open 2 250B parameter open-weight model for agentic tasksGeneral · Open weights · 2026 Qwen3.8-2.4T-A95B 🇨🇳 ChinaQwen3.8-2.4T-A95B Open-weight reasoning model with 2.4 trillion parametersReasoning · Open weights · 2026 Falcon-H1R-7B 🇦🇪 United Arab EmiratesFalcon-H1R-7B A 7-billion parameter reasoning model with hybrid architectureReasoning · Open weights · 2026 Falcon-H1 🇦🇪 United Arab EmiratesFalcon-H1 Hybrid transformer and state-space model series by TIIGeneral · Open weights · 2025 Kimi Linear 🇨🇳 ChinaKimi Linear Hybrid linear attention model with 48 billion parametersGeneral · Open weights · 2025 MiniMax-Text-01 🇨🇳 ChinaMiniMax-Text-01 A large language model with a four million token context window.General · Open weights · 2025 ERNIE 3.0 🇨🇳 ChinaERNIE 3.0 Knowledge-enhanced pre-training model for language tasksGeneral · Research only · 2021 Hunyuan-TurboS 🇨🇳 ChinaHunyuan-TurboS Hybrid Mamba-Transformer MoE model by TencentGeneral · API only · 2025 Zamba2 🇺🇸 United StatesZamba2 Hybrid Mamba2-transformer language model suite by ZyphraGeneral · Open weights · 2024 Jamba 🇮🇱 IsraelJamba Hybrid open-weights language model with long contextGeneral · Open weights · 2024

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.