Mid-size: 10 to 70 billion
The workhorse open models: Llama 2 13B, Qwen 32B, Gemma 27B and their kin. 103 models.
🇺🇸 United StatesTalkie
A 13B small language model trained only on pre-1931 public domain English textSmall · Open weights · 2026
🇺🇸 United StatesPythia
A suite of 16 models for interpretability research.Research · Open weights · 2023
WorldINTELLECT-1
A 10 billion parameter model trained by a global community.General · Open weights · 2024
🇺🇸 United StatesCerebras-GPT
Open compute-optimal language models from Cerebras SystemsGeneral · Open weights · 2023
🇺🇸 United StatesGPT-NeoX-20B
Open 20 billion parameter autoregressive language model by EleutherAIGeneral · Open weights · 2022
🇨🇳 ChinaCogVLM
Open-source visual language model with deep feature fusionMultimodal · Open weights · 2023