Language Models are Unsupervised Multitask Learners
Milestone Papers
Language Models are Unsupervised Multitask Learners

(2019-02) GPT 2.0 by OpenAI

Paper
(2019-02) GPT 2.0 by OpenAI

Relevant Sites

The Llama 3 Herd of Models

(2024-05) Llama3 by Meta

OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization

(2022-12) OPT-IML by Meta

Visual Instruction Tuning

(2023-04) LLaVA by UW–Madison&Microsoft

Mistral 7B

(2023-10) Mistral 7B by Mistral

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

(2024-05) Mamba2 by CMU&Princeton

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

(2022-11) BLOOM by BigScience

Leave a Reply

Your email address will not be published. Required fields are marked *