News
ResearchOpenAI pens AI safety agreement with four firmsReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierOpenAI’s New Hacking Model Found Dozens Of Holes In Apple TechFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIResearchOpenAI pens AI safety agreement with four firmsReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierOpenAI’s New Hacking Model Found Dozens Of Holes In Apple TechFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAI
EveryLLM

Lab city, United States

Mountain View and Palo Alto

Google's headquarters and Stanford University: where the transformer, BERT and Gemini were born.

The stretch of Silicon Valley between Google's headquarters in Mountain View and Stanford University beside Palo Alto produced much of the science behind today's models. Google researchers published the transformer in 2017 and BERT in 2018, and Google DeepMind's Gemini is built partly here. Stanford trains many of the field's researchers and runs some of its best-known measurement projects.

Google

Google Brain, started in 2011, and Google Research produced Word2Vec (2013), the transformer paper Attention Is All You Need (June 2017), BERT (2018), T5 (2019), LaMDA (2021) and PaLM (2022), a 540-billion-parameter model trained on 6,144 TPU v4 chips, Google's own AI accelerators. In April 2023 Google Brain merged with London's DeepMind to form Google DeepMind, which builds the Gemini models and the open Gemma family.

Stanford

Stanford's Institute for Human-Centered Artificial Intelligence (HAI), founded in 2019, publishes the annual AI Index, a widely cited record of models, costs and policy. Its Center for Research on Foundation Models coined the term foundation model in 2021 and runs the HELM evaluations. In March 2023 Stanford's Alpaca showed that a small Llama model tuned on 52,000 examples could mimic a commercial chatbot, starting a wave of cheap open fine-tunes.

Models of Mountain View and Palo Alto

Still to be written: Word2Vec.

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.