Compact: 1 to 10 billion
Phi, Gemma, Llama 3 8B, Mistral 7B and most on-device and edge models. 82 models.
WorldZamba
A 7-billion parameter hybrid language model combining Mamba and transformer layers.General 路 Open weights 路 2024
馃嚭馃嚫 United StatesLFM2
Hybrid language models for edge and on-device useSmall 路 Open weights
馃嚭馃嚫 United StatesZamba2
Hybrid Mamba2-transformer language model suite by ZyphraGeneral 路 Open weights 路 2024