Search: scaling
Concepts
🇺🇸 United StatesGPT-2
OpenAI's 2019 text model that predicts the next word in a sequenceGeneral · Open weights · 2019
🇬🇧 United KingdomGopher
A 280 billion parameter Transformer language model from DeepMind, studied for how scale changes ability.Research · Research only · 2021
🇰🇷 South KoreaSOLAR 10.7B
An 11-billion parameter language model using depth up-scaling.General · Open weights · 2023
🇺🇸 United StatesPythia
A suite of 16 models for interpretability research.Research · Open weights · 2023
🇺🇸 United StatesS1
A reasoning model using test-time scaling and budget forcingReasoning · Fully open · 2025
🇺🇸 United StatesCerebras-GPT
Open compute-optimal language models from Cerebras SystemsGeneral · Open weights · 2023
🇵🇱 PolandBielik
Polish-optimised 11 billion parameter language modelGeneral · Open weights · 2025
🇨🇳 ChinaGLM-5
Open-weight model for engineering and agentic tasksGeneral · Open weights · 2026
🇨🇳 ChinaERNIE 3.0 Titan
Large-scale Chinese knowledge-enhanced pre-trained language modelGeneral · Research only · 2021
WorldSwitch Transformer
A sparse mixture-of-experts language model scaling to a trillion parameters.Research · Research only · 2021
🇺🇸 United StatesFlan-T5
Instruction-finetuned T5 checkpoints released by Google for zero-shot and few-shot workGeneral · Open weights · 2022