Very large: 300 billion to 1 trillion
PaLM, Llama 3.1 405B, DeepSeek-V3 and the big mixture-of-experts models. 37 models.
🇨🇳 ChinaGLM
Open-weight Chinese model series used for chat and codingGeneral · Open weights · 2021
WorldInkling
An open-weights mixture-of-experts model handling text, images and audio inputGeneral · Open weights · 2026
WorldMiniMax-M3
Native multimodal model with 1M context and sparse attentionMultimodal · Open weights
🇨🇳 ChinaMiMo-V2-Flash
High-speed MoE language model for reasoning and agentsGeneral · Open weights
🇺🇸 United StatesSnowflake Arctic
Open enterprise language model with hybrid MoE designGeneral · Open weights · 2024
🇺🇸 United StatesTrinity Large
398B-parameter sparse MoE model family by Arcee AIGeneral · Open weights · 2026
🇨🇳 ChinaDeepSeek-V3.1
Hybrid thinking and non-thinking language model with 671 billion parameters.General · Open weights
🇨🇳 ChinaDeepSeek-Prover-V2
Open-source model for formal theorem proving in Lean 4Reasoning · Open weights · 2025
🇰🇷 South KoreaK-EXAONE 2.0
Open-weight multilingual language model by LG AI ResearchGeneral · Open weights
🇰🇷 South KoreaA.X K1
Sparse MoE model with controllable reasoning depthGeneral · Open weights · 2026
🇨🇳 ChinaQwen3-Coder
Agentic coding model with 480 billion parametersCode · Open weights · 2025
🇨🇳 ChinaQwen3.5-397B-A17B
A large multimodal language model with sparse activation.General · Open weights
🇨🇳 ChinaGLM-4.5
Open-source mixture of experts model for agents and reasoningGeneral · Open weights · 2025
🇨🇳 ChinaMiniMax-Text-01
A large language model with a four million token context window.General · Open weights · 2025
🇨🇳 ChinaMiniMax-M1
Open-weight reasoning model with hybrid attention and long contextReasoning · Open weights · 2025
🇨🇳 ChinaLongCat-Flash
Efficient 560B parameter MoE model for agentic tasksGeneral · Open weights · 2025
🇨🇳 ChinaGLM-5
Open-weight model for engineering and agentic tasksGeneral · Open weights · 2026
🇨🇳 ChinaERNIE 4.5
Baidu's multimodal mixture-of-experts language model series.General · Open weights · 2025
🇨🇳 ChinaStep3
Multimodal reasoning model with 321 billion parametersMultimodal · Open weights · 2025
🇺🇸 United StatesGrok-1
xAI's 314 billion parameter open-weights mixture-of-experts base modelGeneral · Open weights · 2024
🇨🇳 ChinaHunyuan-Large
Open-source mixture of experts model with 389 billion parametersGeneral · Open weights · 2024
🇫🇷 FranceMistral Large 3
A 675B-parameter open-weight mixture-of-experts multimodal model from Mistral AIGeneral · Open weights
WorldStep-5-Preview
Agentic model with 600B parameters and 1M token contextGeneral · Open weights · 2026
🇨🇳 ChinaDeepSeek-V3
Open-weight mixture of experts language model with 671 billion parameters.General · Open weights · 2024