Improving Language Understanding by Generative Pre-Training
Milestone Papers
Improving Language Understanding by Generative Pre-Training

(2018-06) GPT 1.0 by OpenAI

Paper
(2018-06) GPT 1.0 by OpenAI

Relevant Sites

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

(2024-01) DeepSeek-v2 by DeepSeek

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

(2022-11) BLOOM by BigScience

Resurrecting Recurrent Neural Networks for Long Sequences

(2023-03) LRU by DeepMind

Training language models to follow instructions with human feedback

(2022-03) InstructGPT by OpenAI

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

(2021-01) Switch Transformers by Google

Improving alignment of dialogue agents via targeted human judgements

(2022-09) Sparrow by DeepMind

Leave a Reply

Your email address will not be published. Required fields are marked *