News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Search: scaling

Concepts

GPT-2 🇺🇸 United StatesGPT-2 OpenAI's 2019 text model that predicts the next word in a sequenceGeneral · Open weights · 2019 Gopher 🇬🇧 United KingdomGopher A 280 billion parameter Transformer language model from DeepMind, studied for how scale changes ability.Research · Research only · 2021 SOLAR 10.7B 🇰🇷 South KoreaSOLAR 10.7B An 11-billion parameter language model using depth up-scaling.General · Open weights · 2023 Pythia 🇺🇸 United StatesPythia A suite of 16 models for interpretability research.Research · Open weights · 2023 S1 🇺🇸 United StatesS1 A reasoning model using test-time scaling and budget forcingReasoning · Fully open · 2025 Cerebras-GPT 🇺🇸 United StatesCerebras-GPT Open compute-optimal language models from Cerebras SystemsGeneral · Open weights · 2023 Bielik 🇵🇱 PolandBielik Polish-optimised 11 billion parameter language modelGeneral · Open weights · 2025 fnGLM-5 🇨🇳 ChinaGLM-5 Open-weight model for engineering and agentic tasksGeneral · Open weights · 2026 ERNIE 3.0 Titan 🇨🇳 ChinaERNIE 3.0 Titan Large-scale Chinese knowledge-enhanced pre-trained language modelGeneral · Research only · 2021 Switch Transformer WorldSwitch Transformer A sparse mixture-of-experts language model scaling to a trillion parameters.Research · Research only · 2021 Flan-T5 🇺🇸 United StatesFlan-T5 Instruction-finetuned T5 checkpoints released by Google for zero-shot and few-shot workGeneral · Open weights · 2022

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.