Release anniversaries, 28 May 2027
GPT-3 paper published
On 28 May 2020 OpenAI posted "Language Models are Few-Shot Learners", describing the 175-billion-parameter GPT-3.
OpenAI's paper on GPT-3 was posted on 28 May 2020. At 175 billion parameters, more than a hundred times larger than GPT-2, the model showed that a single network could translate, answer questions, write code and solve puzzles from a few examples in its prompt, without fine-tuning. OpenAI offered it through an API from June 2020 rather than releasing the weights, and licensed it exclusively to Microsoft that September. The paper also discussed bias and misuse, and won a best paper award at NeurIPS 2020.