Mid-size: 10 to 70 billion
The workhorse open models: Llama 2 13B, Qwen 32B, Gemma 27B and their kin. 103 models.
WorldMM1
A family of multimodal language models up to 30B parameters, dense and MoE.Multimodal 路 Research only 路 2024
馃嚭馃嚫 United StatesAlexaTM 20B
A 20-billion-parameter multilingual sequence-to-sequence model from Amazon's Alexa team.General 路 Research only 路 2022
馃嚭馃嚫 United StatesOrca 2
A small LLaMA-2-based model trained on synthetic data to reason.Small 路 Conditional licence 路 2023
馃嚚馃嚦 ChinaERNIE 3.0
Knowledge-enhanced pre-training model for language tasksGeneral 路 Research only 路 2021