Very large: 300 billion to 1 trillion
PaLM, Llama 3.1 405B, DeepSeek-V3 and the big mixture-of-experts models. 37 models.
🇺🇸 United StatesPaLM
Google AI's 540-billion-parameter dense decoder-only transformer language modelGeneral · API only · 2022
🇺🇸 United StatesMed-PaLM
A medical-domain language model aligned from Flan-PaLM using instruction prompt tuning.Domain · Research only · 2022
🇺🇸 United StatesMegatron-Turing NLG 530B
A 530-billion-parameter generative language model trained by Microsoft and NVIDIA.General · Research only · 2022