News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Speech and audio

Listens and speaks. 42 models on EveryLLM so far.

Speech and audio models listen and speak. Older voice assistants chained three systems: speech recognition to turn speech into text, a language model, and text-to-speech. Newer models are trained on audio directly, so they hear tone and hesitation, can reply in natural speech within a fraction of a second, and let users interrupt them mid-sentence.

Listening

OpenAI's Whisper, released as open source in September 2022, was trained on 680,000 hours of multilingual audio from the web and became a standard tool for transcription. Language models now accept audio directly: Gemini models take long recordings, and Alibaba's Qwen2.5-Omni (March 2025) reads text, images, audio and video in one model. In India, Sarvam AI and the government's Bhashini programme focus on speech in Indian languages.

Speaking

GPT-4o, shown in May 2024, answered spoken questions in about 320 milliseconds on average, close to human turn-taking, and ChatGPT's Advanced Voice Mode reached paying users from September 2024. In July 2024 the Paris lab Kyutai demonstrated Moshi, a model that listens and speaks at the same time, and later released it openly. Voice cloning raises fraud risks, so most providers limit the choice of voices.

Famous speech and audio models

Still to be written: GPT-4o.

Further reading

imgwavGPT-4 🇺🇸 United StatesGPT-4 Multimodal large language model by OpenAIGeneral · API only · 2023 imgwavvidGemini 🇺🇸 United StatesGemini Google DeepMind's multimodal LLM family, from Nano to UltraGeneral · API only · 2023 imgwavvidGemma 🇺🇸 United StatesGemma Google DeepMind's open family of Gemini-derived language modelsGeneral · Open weights · 2024 wavDoubao 🇨🇳 ChinaDoubao ByteDance's conversational virtual assistant and language model familyAssistant · API only · 2023 imgwavfnGato 🇬🇧 United KingdomGato A single DeepMind network handling dialogue, games and robot controlGeneral · 2022 imgwavvidQwen 🇨🇳 ChinaQwen A family of large and small language models developed by Alibaba Cloud.General · Open weights · 2023 imgwavvidVideoPoet 🇺🇸 United StatesVideoPoet A Google Research language model that turns text and images into video and audioMultimodal · Research only · 2023 imgwavKimi 🇨🇳 ChinaKimi A Chinese chatbot and large language model family by Moonshot AI.Assistant · API only · 2023 imgwavvidGemma 4 🇺🇸 United StatesGemma 4 Google DeepMind's open multimodal models in five sizes, from phones to serversGeneral · Open weights imgwavPhi-4-multimodal 🇺🇸 United StatesPhi-4-multimodal A small open model that reads text, images and audio and replies in textMultimodal · Open weights · 2025 imgwavvidQwen2.5-Omni 🇨🇳 ChinaQwen2.5-Omni End-to-end multimodal model for real-time speech and video chat.Multimodal · Open weights · 2025 wavVoxtral 🇫🇷 FranceVoxtral Open audio chat models that transcribe, answer questions and summarise speechMultimodal · Open weights · 2025 wavMoshi 🇫🇷 FranceMoshi Real-time full-duplex spoken dialogue modelMultimodal · Open weights · 2024 imgwavfnFanar 🇶🇦 QatarFanar Arabic-centric multimodal generative AI platform and modelsMultimodal · API only · 2025 imgwavvidGemma 3n 🇺🇸 United StatesGemma 3n Mobile-first open model family for on-device text, image and audio workMultimodal · Open weights · 2025 imgwavGemini 2.0 Flash 🇺🇸 United StatesGemini 2.0 Flash Google DeepMind's fast multimodal workhorse model for agentic appsGeneral · API only · 2024 imgwavvidReka Core 🇸🇬 SingaporeReka Core Multimodal language model by RekaMultimodal · API only · 2024 imgwavvidGemini 1.0 🇺🇸 United StatesGemini 1.0 Google's first Gemini models: multimodal AI in Ultra, Pro and Nano sizesMultimodal · API only · 2023 imgwavvidGemini 3.1 Flash-Lite 🇺🇸 United StatesGemini 3.1 Flash-Lite A fast, low-cost multimodal reasoning model for high-volume tasksMultimodal · API only · 2026 imgwavChatGPT 🇺🇸 United StatesChatGPT Generative AI chatbot by OpenAIAssistant · API only · 2022

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.