Compact: 1 to 10 billion
Phi, Gemma, Llama 3 8B, Mistral 7B and most on-device and edge models. 82 models.
WorldZamba
A 7-billion parameter hybrid language model combining Mamba and transformer layers.General · Open weights · 2024
🇺🇸 United StatesLFM2
Hybrid language models for edge and on-device useSmall · Open weights
🇺🇸 United StatesZamba2
Hybrid Mamba2-transformer language model suite by ZyphraGeneral · Open weights · 2024