Unifying Language Learning Paradigms
Milestone Papers
Unifying Language Learning Paradigms

(2022-05) UL2 by Google

Paper
(2022-05) UL2 by Google

Relevant Sites

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

(2021-01) Switch Transformers by Google

Qwen2.5 Technical Report

(2024-12) Qwen2.5 by Alibaba

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

(2021-12) GLaM by Google

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

(2019-10) T5 by Google

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

(2022-01) COT by Google

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

(2019-09) Megatron-LM by NVIDIA

Leave a Reply

Your email address will not be published. Required fields are marked *