Training language models to follow instructions with human feedback
Milestone Papers
Training language models to follow instructions with human feedback

(2022-03) InstructGPT by OpenAI

Paper
(2022-03) InstructGPT by OpenAI

Relevant Sites

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

(2022-11) BLOOM by BigScience

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

(2019-09) Megatron-LM by NVIDIA

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

(2021-12) GLaM by Google

Llama 2: Open Foundation and Fine-Tuned Chat Models

(2023-07) LLaMA2 by Meta

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

(2021-01) Switch Transformers by Google

Resurrecting Recurrent Neural Networks for Long Sequences

(2023-03) LRU by DeepMind

Leave a Reply

Your email address will not be published. Required fields are marked *