Upon release of GPT-2 in February 2019, OpenAI adopted a staggered approach to the release of the largest form of the model on the claim that text it generated was too realistic and dangerous to release. That approach sparked debate about how to responsibly release large language models, as well as criticism that the elaborate release method was designed to drum up publicity.
Despite GPT-3 being more than 100 times larger than GPT-2—with a well-documented bias toward Black people, Muslims, and other groups of people—efforts to commercialize GPT-3 with exclusive partner Microsoft went forward in 2020 with no specific data-driven or quantitative method to determine whether the model was fit for release.
Altman suggested that DALL-E 2 may follow the same approach to GPT-3. “There aren’t obvious metrics that we’ve all agreed on that we can point to that society can say this is the…