Unifying Language Learning Paradigms
Milestone Papers
Unifying Language Learning Paradigms

(2022-05) UL2 by Google

Paper
(2022-05) UL2 by Google

Relevant Sites

Language models are few-shot learners

(2020-05) GPT 3.0 by OpenAI

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

(2022-11) BLOOM by BigScience

Resurrecting Recurrent Neural Networks for Long Sequences

(2023-03) LRU by DeepMind

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

(2024-05) Mamba2 by CMU&Princeton

Direct Preference Optimization: Your Language Model is Secretly a Reward Model

(2023-05) DPO by Stanford

LLaMA: Open and Efficient Foundation Language Models

(2023-02) LLaMA by Meta

Leave a Reply

Your email address will not be published. Required fields are marked *