News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Code models

Codex, Code Llama, StarCoder, Qwen Coder and Codestral. 53 models on EveryLLM so far.

Code models are language models trained or tuned to read and write software. They complete a line as a programmer types, turn a plain-English request into a function, explain unfamiliar code, write tests and, in their newest form, act as agents that edit a whole repository and run its tests. Source code is unusually good training data: it is plentiful on the public web, highly structured and easy to check by running it.

From Codex to Copilot

OpenAI's Codex, described in a July 2021 paper, was a GPT-3 model fine-tuned on public code from GitHub. Fine-tuning means further training a finished model on a narrower dataset. Codex powered GitHub Copilot, which opened as a preview in June 2021. The same paper introduced HumanEval, 164 hand-written programming problems checked by unit tests, which became the first standard yardstick for code models.

Open code models

Open-weights code models followed quickly. BigCode, a project led by Hugging Face and ServiceNow, released StarCoder in May 2023, trained on permissively licensed code in more than 80 programming languages. Meta released Code Llama in August 2023, and Mistral's Codestral, DeepSeek-Coder, IBM's Granite code models and Alibaba's Qwen Coder series followed. Many now handle hundreds of thousands of tokens, enough to read a sizeable codebase at once.

Agents that write software

Since 2024 the focus has moved from completing lines to finishing tasks. SWE-bench, released by Princeton researchers in October 2023, asks a model to fix real issues from GitHub projects. Coding agents such as Anthropic's Claude Code and OpenAI's Codex agent, both launched in 2025, read files, run commands and propose changes. Open questions remain over the licensing of training code, the security of generated code and how much human review is still needed.

Famous code models

Still to be written: GitHub Copilot, OpenAI Codex.

Further reading

fnOpenAI Codex 🇺🇸 United StatesOpenAI Codex A code-writing language model fine-tuned from GPT-3Code · API only · 2025 imgfnGPT-5.3-Codex 🇺🇸 United StatesGPT-5.3-Codex OpenAI's code-focused large language model with repository and terminal accessCode · API only · 2026 fnGPT-5.6 🇺🇸 United StatesGPT-5.6 OpenAI's 2026 model family in Luna, Terra and Sol tiersGeneral · API only · 2026 IBM Granite 🇺🇸 United StatesIBM Granite IBM's decoder-only foundation models, from 3 to 34 billion parametersGeneral · Open weights · 2023 fnCodestral 🇫🇷 FranceCodestral Mistral AI's 22B open-weight model built for code generation across 80+ languagesCode · Conditional licence Falcon 3 🇦🇪 United Arab EmiratesFalcon 3 Open foundation models from 1B to 10B parameters by TIIGeneral · Open weights · 2024 StarCoder2 WorldStarCoder2 Open code generation model by BigCodeCode · Open weights · 2024 fnDevstral 🇫🇷 FranceDevstral A 24B agentic coding model built by Mistral AI and All Hands AICode · Open weights · 2025 OpenCoder WorldOpenCoder Open code model family with full training data and pipelineCode · Open weights · 2024 StarCoder WorldStarCoder Open code generation model with 15.5 billion parametersCode · Open weights · 2023 Qwen-72B 🇨🇳 ChinaQwen-72B A 72-billion parameter open-weight language model from Alibaba Cloud.General · Open weights · 2023 Kanana 🇰🇷 South KoreaKanana Bilingual language models for Korean and English by Kakao.General · Open weights · 2025 fnGLM-4.7 🇨🇳 ChinaGLM-4.7 Coding and reasoning model from Z.aiCode · Open weights fnGLM-5.3 🇨🇳 ChinaGLM-5.3 Open-weights coding and cyber-security model from Z.aiCode · Open weights · 2026 fnMiniMax-M2.5 🇨🇳 ChinaMiniMax-M2.5 Cost-efficient coding and agentic model from MiniMax AICode · API only · 2026 MiMo-7B 🇨🇳 ChinaMiMo-7B Open reasoning model from Xiaomi for maths and codeReasoning · Open weights · 2025 fnGrok Code Fast 1 🇺🇸 United StatesGrok Code Fast 1 A fast, low-cost reasoning model built for agentic coding work.Reasoning · API only · 2026 imgfnDevstral 2 🇫🇷 FranceDevstral 2 Open-weight coding model family for software agentsCode · Open weights · 2026 Qwen2.5-72B 🇨🇳 ChinaQwen2.5-72B A 72-billion parameter open-weight language model from Alibaba Cloud.General · Open weights · 2024 CodeGen 🇺🇸 United StatesCodeGen Open autoregressive language model for code generationCode · Open weights · 2022 DeepSeek Coder 🇨🇳 ChinaDeepSeek Coder Open-source code generation models from DeepSeekCode · Open weights · 2024 Qwen2 🇨🇳 ChinaQwen2 Open-weight language model series from AlibabaGeneral · Open weights · 2024 Qwen2.5-Coder 🇨🇳 ChinaQwen2.5-Coder Open code-specialised language model series by Alibaba CloudCode · Open weights · 2024 AlphaCode 🇬🇧 United KingdomAlphaCode A code generation system that solves competitive programming problems.Code · Research only · 2022 imgClaude Opus 4.7 🇺🇸 United StatesClaude Opus 4.7 Anthropic's large model for long-running coding and professional workGeneral · API only · 2026 DeepSeek-V2 🇨🇳 ChinaDeepSeek-V2 Efficient mixture-of-experts language model with 236 billion parametersGeneral · Open weights · 2024 fnClaude Haiku 4.5 🇺🇸 United StatesClaude Haiku 4.5 Anthropic's small, fast Claude model for coding, agents and real-time workGeneral · API only · 2025 Code Llama 🇺🇸 United StatesCode Llama Meta's code-specialised family of Llama 2 models in four sizesCode · Conditional licence · 2023 Phi-1 🇺🇸 United StatesPhi-1 A small Microsoft model specialised for basic Python codingCode · Open weights · 2023 fnNorth Mini Code 🇺🇸 United StatesNorth Mini Code A 30B sparse mixture-of-experts model for code and terminal agent workCode · Conditional licence Granite Code 🇺🇸 United StatesGranite Code IBM's open code models from 3B to 34B parameters for coding tasksCode · Open weights · 2024 fnInternLM2 🇨🇳 ChinaInternLM2 Open-source 20 billion parameter language model with long context supportGeneral · Open weights · 2024 fnMiniMax-M2.7 🇨🇳 ChinaMiniMax-M2.7 Open-weight model for coding and agent tasksCode · Open weights fnDevin 🇺🇸 United StatesDevin Autonomous software engineering agent by Cognition LabsCode · API only

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.