An empirical analysis of compute-optimal large language model training
Milestone Papers
An empirical analysis of compute-optimal large language model training

(2022-04) Chinchilla by DeepMind

Paper
(2022-04) Chinchilla by DeepMind

Relevant Sites

PaLM: Scaling Language Modeling with Pathways

(2022-04) PaLM by Google

Unifying Language Learning Paradigms

(2022-05) UL2 by Google

Evaluating Large Language Models Trained on Code

(2021-08) Codex by OpenAI

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

(2022-11) BLOOM by BigScience

Scaling Instruction-Finetuned Language Models

(2022-10) Flan-T5/PaLM by Google

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

(2022-01) COT by Google

Leave a Reply

Your email address will not be published. Required fields are marked *