Unifying Language Learning Paradigms
Milestone Papers
Unifying Language Learning Paradigms

(2022-05) UL2 by Google

Paper
(2022-05) UL2 by Google

Relevant Sites

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning

(2023-01) Flan 2022 Collection by Google

Scaling Laws for Neural Language Models

(2020-01) Scaling Law by OpenAI

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

(2024-01) DeepSeek-v2 by DeepSeek

Multitask Prompted Training Enables Zero-Shot Task Generalization

(2021-10) T0 by HuggingFace et al.

Holistic Evaluation of Language Models

(2022-11) HELM by Stanford

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

(2023-12) Mamba by CMU&Princeton

Leave a Reply

Your email address will not be published. Required fields are marked *