Search: Grouped-query attention
Concepts
🇫🇷 FranceMistral 7B
A 7.3 billion parameter open language model from Mistral AIGeneral · Open weights · 2023
🇮🇳 IndiaPragna-1B
Small decoder model for Hindi, Bangla, Gujarati and EnglishSmall · Open weights
🇺🇸 United StatesLlama 3
Meta's open-weight language model family in 8B and 70B sizesGeneral · Conditional licence · 2024