News
ResearchOpenAI pens AI safety agreement with four firmsReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierOpenAI’s New Hacking Model Found Dozens Of Holes In Apple TechFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIResearchOpenAI pens AI safety agreement with four firmsReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierOpenAI’s New Hacking Model Found Dozens Of Holes In Apple TechFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAI
EveryLLM

All models

471 models so far, best known first. 21 more are on the list to be written.

ELECTRA WorldELECTRA A pre-training method that trains text encoders to spot replaced tokens.Research · Research only · 2020 RETRO WorldRETRO A retrieval-enhanced transformer that conditions on chunks from a huge document database.Research · Research only · 2021 fnToolformer 🇺🇸 United StatesToolformer A language model that learns on its own when to call external tools through APIs.Research · Research only · 2023 imgPaLM-E WorldPaLM-E An embodied multimodal language model that grounds words in robot sensor inputMultimodal · Research only · 2023 Galactica 🇺🇸 United StatesGalactica A language model trained on scientific text for research tasksDomain · Conditional licence · 2022 imgMM1 WorldMM1 A family of multimodal language models up to 30B parameters, dense and MoE.Multimodal · Research only · 2024 AlexaTM 20B 🇺🇸 United StatesAlexaTM 20B A 20-billion-parameter multilingual sequence-to-sequence model from Amazon's Alexa team.General · Research only · 2022 Orca 2 🇺🇸 United StatesOrca 2 A small LLaMA-2-based model trained on synthetic data to reason.Small · Conditional licence · 2023 Phi-2 🇺🇸 United StatesPhi-2 A 2.7 billion parameter Microsoft research model for QA, chat and codeResearch · Open weights InstructGPT 🇺🇸 United StatesInstructGPT GPT-3 models fine-tuned with human feedback to follow instructionsGeneral · API only · 2022 fnWebGPT 🇺🇸 United StatesWebGPT A GPT-3 model fine-tuned to answer questions while browsing the webGeneral · Research only · 2021 RecurrentGemma 🇺🇸 United StatesRecurrentGemma Open language models using Google's Griffin recurrent-plus-attention architectureGeneral · Open weights · 2024 Med-PaLM 🇺🇸 United StatesMed-PaLM A medical-domain language model aligned from Flan-PaLM using instruction prompt tuning.Domain · Research only · 2022 Switch Transformer WorldSwitch Transformer A sparse mixture-of-experts language model scaling to a trillion parameters.Research · Research only · 2021 GLaM 🇺🇸 United StatesGLaM A trillion-parameter mixture-of-experts language model from Google ResearchResearch · Research only · 2021 Minerva 🇺🇸 United StatesMinerva A language model trained further on technical content to solve maths and science problemsResearch · Research only · 2022 ALBERT 🇺🇸 United StatesALBERT A slimmed-down BERT encoder that shares weights across its layersEncoder · Open weights · 2019 imgvidFlamingo 🇬🇧 United KingdomFlamingo A visual language model family that learns new image and video tasks from a few examples.Multimodal · Research only · 2022 Gopher 🇬🇧 United KingdomGopher A 280 billion parameter Transformer language model from DeepMind, studied for how scale changes ability.Research · Research only · 2021

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.