Attention Is All You Need
Milestone Papers
Attention Is All You Need

(2017-06) Transformers by Google

Paper
(2017-06) Transformers by Google

Relevant Sites

OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization

(2022-12) OPT-IML by Meta

ZeRO: Memory Optimizations Toward Training Trillion Parameter Models

(2019-10) ZeRO by Microsoft

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

(2022-01) COT by Google

PaLM-E: An Embodied Multimodal Language Model

(2023-03) PaLM-E by Google

DeepSeek-R1 91,457

(2025-1) DeepSeek-R1 by DeepSeek

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

(2019-10) T5 by Google

Leave a Reply

Your email address will not be published. Required fields are marked *