Search: Latency
Concepts
🇺🇸 United StatesGpt-oss-20b
OpenAI's smaller open-weight reasoning model for local and low-latency useReasoning · Open weights · 2025
🇺🇸 United StatesClaude 3.5 Haiku
Anthropic's fast, low-latency model for coding, tools and user-facing productsGeneral · API only · 2024
🇺🇸 United StatesGemini 3.1 Flash-Lite
A fast, low-cost multimodal reasoning model for high-volume tasksMultimodal · API only · 2026
🇺🇸 United StatesGemini 3.5 Flash
A multimodal reasoning model from Google DeepMind with adjustable thinking levelsGeneral · API only · 2026
🇨🇳 ChinaKimi K2 Thinking
Open-source reasoning model with tool use and INT4 quantizationReasoning · Open weights
🇫🇷 FranceMoshi
Real-time full-duplex spoken dialogue modelMultimodal · Open weights · 2024
🇫🇷 FranceMistral Small 3
A 24B open-weight model tuned for low latency and local deploymentGeneral · Open weights · 2025
🇫🇷 FranceMinistral 3B and 8B
Two small Mistral AI models built for on-device and edge computing.Small · API only · 2024
🇺🇸 United StatesZamba2
Hybrid Mamba2-transformer language model suite by ZyphraGeneral · Open weights · 2024
🇨🇳 ChinaMiniMax-M2
Open-source MoE model for coding and agentsCode · Open weights
🇨🇳 ChinaQwen2.5-Omni
End-to-end multimodal model for real-time speech and video chat.Multimodal · Open weights · 2025