Attention Is All You Need
Milestone Papers
Attention Is All You Need

(2017-06) Transformers by Google

Paper
(2017-06) Transformers by Google

Relevant Sites

DeepSeek-R1 91,056

(2025-1) DeepSeek-R1 by DeepSeek

LLaMA: Open and Efficient Foundation Language Models

(2023-02) LLaMA by Meta

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

(2018-10) BERT by Google

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

(2023-12) Mamba by CMU&Princeton

WebGPT: Browser-assisted question-answering with human feedback

(2021-12) WebGPT by OpenAI

ZeRO: Memory Optimizations Toward Training Trillion Parameter Models

(2019-10) ZeRO by Microsoft

Leave a Reply

Your email address will not be published. Required fields are marked *