Search: efficient inference
🇺🇸 United StatesRecurrentGemma
Open language models using Google's Griffin recurrent-plus-attention architectureGeneral · Open weights · 2024
🇨🇳 ChinaGLM-130B
Open bilingual pre-trained language model with 130 billion parametersGeneral · Open weights · 2022
🇮🇳 IndiaParam-2-17B
Multilingual MoE model for Indian languages and reasoningGeneral · Open weights
🇩🇪 GermanySentence-BERT
Efficient sentence embeddings using Siamese BERT networksEncoder · Open weights · 2019
🇨🇳 ChinaDeepSeek-VL2
Mixture-of-experts vision-language model series for multimodal tasksMultimodal · Open weights · 2024
WorldZamba
A 7-billion parameter hybrid language model combining Mamba and transformer layers.General · Open weights · 2024
WorldEagle and Finch
Efficient recurrent sequence models with matrix statesGeneral · Fully open · 2024
WorldDistilBERT
A smaller, faster version of the BERT language model.Encoder · Open weights · 2019
🇨🇳 ChinaLongCat-Flash
Efficient 560B parameter MoE model for agentic tasksGeneral · Open weights · 2025
WorldRWKV-4
A dense recurrent model with transformer-level performanceGeneral · Open weights · 2023
🇺🇸 United StatesOLMoE
Open mixture-of-experts language model with 1 billion active parametersGeneral · Fully open · 2024