Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
Milestone Papers
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

(2021-01) Switch Transformers by Google

Paper
(2021-01) Switch Transformers by Google

Relevant Sites

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

(2018-10) BERT by Google

Emergent Abilities of Large Language Models

(2022-06) Emergent Abilities by Google

Evaluating Large Language Models Trained on Code

(2021-08) Codex by OpenAI

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

(2022-01) COT by Google

Scaling Instruction-Finetuned Language Models

(2022-10) Flan-T5/PaLM by Google

PaLM: Scaling Language Modeling with Pathways

(2022-04) PaLM by Google

Leave a Reply

Your email address will not be published. Required fields are marked *