Researchers introduce OPT, a suite of open pre-trained transformer language models that match GPT-3's performance while significantly reducing carbon emissions. The release includes full model weights and code to help the research community study large language models.