Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Milestone Papers
Scaling Language Models: Methods, Analysis & Insights from Training Gopher

(2021-12) Gopher by DeepMind

Paper
(2021-12) Gopher by DeepMind

Relevant Sites

Emergent Abilities of Large Language Models

(2022-06) Emergent Abilities by Google

WebGPT: Browser-assisted question-answering with human feedback

(2021-12) WebGPT by OpenAI

LaMDA: Language Models for Dialog Applications

(2022-01) LaMDA by Google

Tree of Thoughts: Deliberate Problem Solving with Large Language Models

(2023-05) ToT by Google&Princeton

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

(2019-09) Megatron-LM by NVIDIA

Evaluating Large Language Models Trained on Code

(2021-08) Codex by OpenAI

Leave a Reply

Your email address will not be published. Required fields are marked *