Search: Layer
Concepts
🇺🇸 United StatesGranite 4.0
IBM's hybrid Mamba/transformer language models for enterprise workGeneral · Open weights · 2025
🇺🇸 United StatesGemma 3n
Mobile-first open model family for on-device text, image and audio workMultimodal · Open weights · 2025
🇺🇸 United StatesALBERT
A slimmed-down BERT encoder that shares weights across its layersEncoder · Open weights · 2019
🇺🇸 United StatesMegatron-LM
Model-parallel training techniques for transformer language models with billions of parametersResearch · Fully open · 2019
🇺🇸 United StatesSnowflake Arctic
Open enterprise language model with hybrid MoE designGeneral · Open weights · 2024
WorldZamba
A 7-billion parameter hybrid language model combining Mamba and transformer layers.General · Open weights · 2024
🇺🇸 United StatesNemotron 3 Nano
NVIDIA's 30B hybrid Mamba-Transformer MoE model for reasoning and agentsGeneral · Conditional licence · 2025