Very large: 300 billion to 1 trillion
PaLM, Llama 3.1 405B, DeepSeek-V3 and the big mixture-of-experts models. 37 models.
WorldBERT
An encoder-only transformer that reads text in both directions at once.Research · Open weights · 2018
🇺🇸 United StatesMed-PaLM
A medical-domain language model aligned from Flan-PaLM using instruction prompt tuning.Domain · Research only · 2022
🇺🇸 United StatesTülu 3
Open post-trained model family built on Llama 3.1General · Open weights · 2024
WorldPaLM-E
An embodied multimodal language model that grounds words in robot sensor inputMultimodal · Research only · 2023