Language Models are Unsupervised Multitask Learners
Milestone Papers
Language Models are Unsupervised Multitask Learners

(2019-02) GPT 2.0 by OpenAI

Paper
(2019-02) GPT 2.0 by OpenAI

Relevant Sites

Scaling Laws for Neural Language Models

(2020-01) Scaling Law by OpenAI

Attention Is All You Need

(2017-06) Transformers by Google

PaLM: Scaling Language Modeling with Pathways

(2022-04) PaLM by Google

Improving alignment of dialogue agents via targeted human judgements

(2022-09) Sparrow by DeepMind

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning

(2023-01) Flan 2022 Collection by Google

LLaMA: Open and Efficient Foundation Language Models

(2023-02) LLaMA by Meta

Leave a Reply

Your email address will not be published. Required fields are marked *