News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

The 2010s

22 models released in the 2010s, year by year.

2019

ALBERT 🇺🇸 United StatesALBERT A slimmed-down BERT encoder that shares weights across its layersEncoder · Open weights · 2019 BART 🇺🇸 United StatesBART A denoising encoder-decoder transformer for generation and comprehension tasksGeneral · Conditional licence · 2019 BioBERT WorldBioBERT Biomedical language model based on BERT architectureDomain · Open weights · 2019 CamemBERT 🇫🇷 FranceCamemBERT French language model based on RoBERTa architectureEncoder · Open weights · 2019 DialoGPT 🇺🇸 United StatesDialoGPT A GPT-style model trained on Reddit threads to write chat repliesGeneral · Open weights · 2019 DistilBERT WorldDistilBERT A smaller, faster version of the BERT language model.Encoder · Open weights · 2019 ERNIE 1.0 🇨🇳 ChinaERNIE 1.0 Knowledge-enhanced language model for Chinese NLP tasks.Encoder · Research only · 2019 GPT-2 🇺🇸 United StatesGPT-2 OpenAI's 2019 text model that predicts the next word in a sequenceGeneral · Open weights · 2019 Megatron-LM 🇺🇸 United StatesMegatron-LM Model-parallel training techniques for transformer language models with billions of parametersResearch · Fully open · 2019 RoBERTa 🇺🇸 United StatesRoBERTa A robustly optimised BERT pretraining study with released models and codeEncoder · Open weights · 2019 SciBERT 🇺🇸 United StatesSciBERT A BERT model trained on scientific text.Domain · Open weights · 2019 Sentence-BERT 🇩🇪 GermanySentence-BERT Efficient sentence embeddings using Siamese BERT networksEncoder · Open weights · 2019 T5 🇺🇸 United StatesT5 Encoder-decoder language model family from Google AI using a text-to-text framework.General · Fully open · 2019 XLM-RoBERTa 🇺🇸 United StatesXLM-RoBERTa A multilingual masked language model covering 100 languages, built on RoBERTa.General · Open weights · 2019 XLNet WorldXLNet Permutation-based autoregressive transformer model created by Google AIResearch · Open weights · 2019

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.