Search: Scaling laws
Concepts
馃嚞馃嚙 United KingdomChinchilla
A 70-billion-parameter DeepMind model built to test how models should scale.Research 路 Research only 路 2022
馃嚭馃嚫 United StatesPythia
A suite of 16 models for interpretability research.Research 路 Open weights 路 2023
馃嚚馃嚦 ChinaDeepSeek LLM 67B
A 67-billion-parameter open-source model trained on English and Chinese text.General 路 Conditional licence 路 2024
馃嚭馃嚫 United StatesCerebras-GPT
Open compute-optimal language models from Cerebras SystemsGeneral 路 Open weights 路 2023