Mid-size: 10 to 70 billion
The workhorse open models: Llama 2 13B, Qwen 32B, Gemma 27B and their kin. 103 models.
WorldAya 101
A 13-billion-parameter multilingual model that follows instructions in 101 languagesGeneral · Open weights · 2024
🇺🇸 United StatesAlexaTM 20B
A 20-billion-parameter multilingual sequence-to-sequence model from Amazon's Alexa team.General · Research only · 2022
🇫🇷 FranceT0
Encoder-decoder model for zero-shot task generalisation via promptsGeneral · Open weights · 2021