Scaling Instruction-Finetuned Language Models
Milestone Papers
Scaling Instruction-Finetuned Language Models

(2022-10) Flan-T5/PaLM by Google

Paper
(2022-10) Flan-T5/PaLM by Google

Relevant Sites

Holistic Evaluation of Language Models

(2022-11) HELM by Stanford

An empirical analysis of compute-optimal large language model training

(2022-04) Chinchilla by DeepMind

Emergent Abilities of Large Language Models

(2022-06) Emergent Abilities by Google

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

(2021-01) Switch Transformers by Google

Solving Quantitative Reasoning Problems with Language Models

(2022-01) Minerva by Google

Resurrecting Recurrent Neural Networks for Long Sequences

(2023-03) LRU by DeepMind

Leave a Reply

Your email address will not be published. Required fields are marked *