Category: 2020 model releases

This category contains 4 pages.

• ELECTRA · A 2020 Google Research and Stanford encoder model pre-trained with replaced token detection, reaching BERT-class quality at a fraction of the compute.
• GPT-3 · OpenAI's 175-billion-parameter language model of 2020, which demonstrated few-shot in-context learning at scale.
• Meena · Google's January 2020 open-domain neural chatbot, a 2.6-billion-parameter conversational model that preceded LaMDA.
• Turing-NLG · Microsoft's 17-billion-parameter language model of February 2020, briefly the largest published language model and the public debut of the DeepSpeed library.