Search: megatron
🇺🇸 United StatesMegatron-LM
Model-parallel training techniques for transformer language models with billions of parametersResearch · Fully open · 2019
🇺🇸 United StatesMegatron-Turing NLG 530B
A 530-billion-parameter generative language model trained by Microsoft and NVIDIA.General · Research only · 2022