News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Speech and audio

Listens and speaks. 42 models on EveryLLM so far.

Speech and audio models listen and speak. Older voice assistants chained three systems: speech recognition to turn speech into text, a language model, and text-to-speech. Newer models are trained on audio directly, so they hear tone and hesitation, can reply in natural speech within a fraction of a second, and let users interrupt them mid-sentence.

Listening

OpenAI's Whisper, released as open source in September 2022, was trained on 680,000 hours of multilingual audio from the web and became a standard tool for transcription. Language models now accept audio directly: Gemini models take long recordings, and Alibaba's Qwen2.5-Omni (March 2025) reads text, images, audio and video in one model. In India, Sarvam AI and the government's Bhashini programme focus on speech in Indian languages.

Speaking

GPT-4o, shown in May 2024, answered spoken questions in about 320 milliseconds on average, close to human turn-taking, and ChatGPT's Advanced Voice Mode reached paying users from September 2024. In July 2024 the Paris lab Kyutai demonstrated Moshi, a model that listens and speaks at the same time, and later released it openly. Voice cloning raises fraud risks, so most providers limit the choice of voices.

Famous speech and audio models

Still to be written: GPT-4o.

Further reading

imgwavvidGemini 🇺🇸 United StatesGemini Google DeepMind's multimodal LLM family, from Nano to UltraGeneral · API only · 2023 imgwavvidGemma 🇺🇸 United StatesGemma Google DeepMind's open family of Gemini-derived language modelsGeneral · Open weights · 2024 imgwavInkling WorldInkling An open-weights mixture-of-experts model handling text, images and audio inputGeneral · Open weights · 2026 imgwavvidQwen 🇨🇳 ChinaQwen A family of large and small language models developed by Alibaba Cloud.General · Open weights · 2023 imgwavKimi 🇨🇳 ChinaKimi A Chinese chatbot and large language model family by Moonshot AI.Assistant · API only · 2023 imgwavvidNemotron 🇺🇸 United StatesNemotron Nvidia family of language and multimodal models for enterprise and reasoningGeneral · Conditional licence · 2023 imgwavvidMiMo-V2.6-Pro 🇨🇳 ChinaMiMo-V2.6-Pro Xiaomi’s 1T parameter multimodal model with 1M token contextMultimodal · Open weights wavfnSarvam-30B 🇮🇳 IndiaSarvam-30B Open-weight MoE model for Indian languages and codingGeneral · Open weights imgwavvidGemini 1.5 Pro 🇺🇸 United StatesGemini 1.5 Pro Google DeepMind's mid-size multimodal model with up to a 1 million token context windowGeneral · API only · 2024 imgwavvidGemma 4 🇺🇸 United StatesGemma 4 Google DeepMind's open multimodal models in five sizes, from phones to serversGeneral · Open weights imgwavvidQwen3-Omni 🇨🇳 ChinaQwen3-Omni Multimodal model processing text, audio, video and images with real-time speech output.Multimodal · Open weights · 2025

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.