Search: hybrid architecture
Concepts
🇺🇸 United StatesNemotron
Nvidia family of language and multimodal models for enterprise and reasoningGeneral · Conditional licence · 2023
🇺🇸 United StatesSnowflake Arctic
Open enterprise language model with hybrid MoE designGeneral · Open weights · 2024
🇺🇸 United StatesNemotron Nano 2
A 9B hybrid Mamba-Transformer model for reasoning and chat, from NVIDIA.General · Open weights · 2025
WorldZamba
A 7-billion parameter hybrid language model combining Mamba and transformer layers.General · Open weights · 2024
🇺🇸 United StatesLFM2
Hybrid language models for edge and on-device useSmall · Open weights
🇯🇵 JapanPLaMo 2
Japanese-focused large language model series by Preferred NetworksGeneral · Open weights · 2025
🇨🇳 ChinaQwen3-Next-80B-A3B
An 80-billion parameter hybrid model with ultra-long context support.General · Open weights
🇨🇳 ChinaQwen3.5-397B-A17B
A large multimodal language model with sparse activation.General · Open weights
🇨🇳 ChinaQwen3.6-35B-A3B
Open-weight multimodal coding model with hybrid architectureCode · Open weights · 2026
🇰🇷 South KoreaSolar Open 2
250B parameter open-weight model for agentic tasksGeneral · Open weights · 2026
🇨🇳 ChinaQwen3.8-2.4T-A95B
Open-weight reasoning model with 2.4 trillion parametersReasoning · Open weights · 2026
🇦🇪 United Arab EmiratesFalcon-H1R-7B
A 7-billion parameter reasoning model with hybrid architectureReasoning · Open weights · 2026
🇦🇪 United Arab EmiratesFalcon-H1
Hybrid transformer and state-space model series by TIIGeneral · Open weights · 2025
🇨🇳 ChinaKimi Linear
Hybrid linear attention model with 48 billion parametersGeneral · Open weights · 2025
🇨🇳 ChinaMiniMax-Text-01
A large language model with a four million token context window.General · Open weights · 2025
🇨🇳 ChinaERNIE 3.0
Knowledge-enhanced pre-training model for language tasksGeneral · Research only · 2021
🇨🇳 ChinaHunyuan-TurboS
Hybrid Mamba-Transformer MoE model by TencentGeneral · API only · 2025
🇺🇸 United StatesZamba2
Hybrid Mamba2-transformer language model suite by ZyphraGeneral · Open weights · 2024
🇮🇱 IsraelJamba
Hybrid open-weights language model with long contextGeneral · Open weights · 2024