Search: pile
🇺🇸 United StatesMegatron-LM
Model-parallel training techniques for transformer language models with billions of parametersResearch · Fully open · 2019
🇺🇸 United StatesCerebras-GPT
Open compute-optimal language models from Cerebras SystemsGeneral · Open weights · 2023
🇺🇸 United StatesGPT-NeoX-20B
Open 20 billion parameter autoregressive language model by EleutherAIGeneral · Open weights · 2022
WorldGPT-Neo
Open autoregressive language model by EleutherAIGeneral · Open weights
WorldRETRO
A retrieval-enhanced transformer that conditions on chunks from a huge document database.Research · Research only · 2021