News
ReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior ReleaseReleasesOVHcloud unveils Olala mini, its first in-house LLMChinaA 9B model beats a 1T model on FinQA, trained with Crusoe Managed RLReleasesThe internal metaphysics of an LLMReleasesMapping Language Model Internal Representations to Physical Laws and Scientific ReasoningResearchCan China keep rogue AI in check? Meet the start-up testing the top modelsFrontierMicrosoft aims to challenge OpenAI, Anthropic with cheaper, specialized AI modelsOpen modelsMicrosoft rolls out new first-party models and updates to agentic AI continuous improvementFrontierMicrosoft unveils AI models for coding, cybersecurity as it takes on Anthropic, OpenAIFrontierGoogle is making it easier to opt out of Gemini AI model training – here’s howFrontierOpenAI Unveils New Astra AI Model After Scrapping Prior Release
EveryLLM

Speech and audio

Listens and speaks. 42 models on EveryLLM so far.

Speech and audio models listen and speak. Older voice assistants chained three systems: speech recognition to turn speech into text, a language model, and text-to-speech. Newer models are trained on audio directly, so they hear tone and hesitation, can reply in natural speech within a fraction of a second, and let users interrupt them mid-sentence.

Listening

OpenAI's Whisper, released as open source in September 2022, was trained on 680,000 hours of multilingual audio from the web and became a standard tool for transcription. Language models now accept audio directly: Gemini models take long recordings, and Alibaba's Qwen2.5-Omni (March 2025) reads text, images, audio and video in one model. In India, Sarvam AI and the government's Bhashini programme focus on speech in Indian languages.

Speaking

GPT-4o, shown in May 2024, answered spoken questions in about 320 milliseconds on average, close to human turn-taking, and ChatGPT's Advanced Voice Mode reached paying users from September 2024. In July 2024 the Paris lab Kyutai demonstrated Moshi, a model that listens and speaks at the same time, and later released it openly. Voice cloning raises fraud risks, so most providers limit the choice of voices.

Famous speech and audio models

Still to be written: GPT-4o.

Further reading

imgwavvidQwen 🇨🇳 ChinaQwen A family of large and small language models developed by Alibaba Cloud.General · Open weights · 2023 imgwavvidVideoPoet 🇺🇸 United StatesVideoPoet A Google Research language model that turns text and images into video and audioMultimodal · Research only · 2023 wavDoubao 🇨🇳 ChinaDoubao ByteDance's conversational virtual assistant and language model familyAssistant · API only · 2023 wavGigaChat 🇷🇺 RussiaGigaChat Sberbank's Russian-language chatbot that writes text, code and makes imagesMultimodal · API only · 2023 imgwavfnGato 🇬🇧 United KingdomGato A single DeepMind network handling dialogue, games and robot controlGeneral · 2022 imgwavGPT-4 🇺🇸 United StatesGPT-4 Multimodal large language model by OpenAIGeneral · API only · 2023 imgwavInkling WorldInkling An open-weights mixture-of-experts model handling text, images and audio inputGeneral · Open weights · 2026 imgwavKimi 🇨🇳 ChinaKimi A Chinese chatbot and large language model family by Moonshot AI.Assistant · API only · 2023 imgwavvidNemotron 🇺🇸 United StatesNemotron Nvidia family of language and multimodal models for enterprise and reasoningGeneral · Conditional licence · 2023 imgwavvidGemini 🇺🇸 United StatesGemini Google DeepMind's multimodal LLM family, from Nano to UltraGeneral · API only · 2023 imgwavvidGemma 🇺🇸 United StatesGemma Google DeepMind's open family of Gemini-derived language modelsGeneral · Open weights · 2024 imgwavMicrosoft Copilot 🇺🇸 United StatesMicrosoft Copilot Microsoft's chatbot assistant built on OpenAI models, replacing Cortana across Windows and Microsoft 365.Assistant · API only · 2023 imgwavvidMiMo-V2.6-Pro 🇨🇳 ChinaMiMo-V2.6-Pro Xiaomi’s 1T parameter multimodal model with 1M token contextMultimodal · Open weights imgwavvidReka Core 🇸🇬 SingaporeReka Core Multimodal language model by RekaMultimodal · API only · 2024 imgwavvidQwen2.5-Omni 🇨🇳 ChinaQwen2.5-Omni End-to-end multimodal model for real-time speech and video chat.Multimodal · Open weights · 2025 wavVoxtral 🇫🇷 FranceVoxtral Open audio chat models that transcribe, answer questions and summarise speechMultimodal · Open weights · 2025 imgwavGemini 2.0 Flash 🇺🇸 United StatesGemini 2.0 Flash Google DeepMind's fast multimodal workhorse model for agentic appsGeneral · API only · 2024 imgwavvidGemini 1.5 Pro 🇺🇸 United StatesGemini 1.5 Pro Google DeepMind's mid-size multimodal model with up to a 1 million token context windowGeneral · API only · 2024 imgwavvidGemini 1.0 🇺🇸 United StatesGemini 1.0 Google's first Gemini models: multimodal AI in Ultra, Pro and Nano sizesMultimodal · API only · 2023 imgwavvidGemini 3 Pro 🇺🇸 United StatesGemini 3 Pro Google DeepMind's Gemini 3 Pro, a multimodal model with a 1 million-token context window.General · API only · 2025 imgwavvidGemini 3.1 Flash-Lite 🇺🇸 United StatesGemini 3.1 Flash-Lite A fast, low-cost multimodal reasoning model for high-volume tasksMultimodal · API only · 2026 imgwavvidGemma 3n 🇺🇸 United StatesGemma 3n Mobile-first open model family for on-device text, image and audio workMultimodal · Open weights · 2025 imgwavvidGemma 4 🇺🇸 United StatesGemma 4 Google DeepMind's open multimodal models in five sizes, from phones to serversGeneral · Open weights imgwavPhi-4-multimodal 🇺🇸 United StatesPhi-4-multimodal A small open model that reads text, images and audio and replies in textMultimodal · Open weights · 2025 imgwavvidQwen3-Omni 🇨🇳 ChinaQwen3-Omni Multimodal model processing text, audio, video and images with real-time speech output.Multimodal · Open weights · 2025 wavMoshi 🇫🇷 FranceMoshi Real-time full-duplex spoken dialogue modelMultimodal · Open weights · 2024 imgwavfnFanar 🇶🇦 QatarFanar Arabic-centric multimodal generative AI platform and modelsMultimodal · API only · 2025 wavShuka v1 🇮🇳 IndiaShuka v1 Audio-native language model for Indic languagesMultimodal · Open weights imgwavChatGPT 🇺🇸 United StatesChatGPT Generative AI chatbot by OpenAIAssistant · API only · 2022

The weekly digest

Every Monday: the model of the day, new pages on EveryLLM, and the conferences and anniversaries of the week ahead.