Search: the pile
WorldGPT-J
A 6-billion-parameter open English text generator from EleutherAI, released in 2021.General 路 Open weights 路 2021
馃嚭馃嚫 United StatesPythia
A suite of 16 models for interpretability research.Research 路 Open weights 路 2023
馃嚭馃嚫 United StatesCerebras-GPT
Open compute-optimal language models from Cerebras SystemsGeneral 路 Open weights 路 2023
馃嚭馃嚫 United StatesGPT-NeoX-20B
Open 20 billion parameter autoregressive language model by EleutherAIGeneral 路 Open weights 路 2022
WorldGPT-Neo
Open autoregressive language model by EleutherAIGeneral 路 Open weights
WorldRETRO
A retrieval-enhanced transformer that conditions on chunks from a huge document database.Research 路 Research only 路 2021