Search: dense model
🇨🇳 ChinaDeepSeekMoE
Mixture-of-experts language model architecture by DeepSeek AIGeneral · Open weights · 2024
🇨🇳 ChinaPangu Ultra
A 135-billion parameter dense language model trained on Ascend hardware.General · API only · 2025
🇰🇷 South KoreaMi:dm 2.0
Korea-centric language model by KTGeneral · Open weights · 2025
WorldRWKV-4
A dense recurrent model with transformer-level performanceGeneral · Open weights · 2023