OPT: Open Pre-trained Transformer Language Models
Milestone Papers
OPT: Open Pre-trained Transformer Language Models

(2022-05) OPT by Meta

Paper
(2022-05) OPT by Meta

Relevant Sites

Attention Is All You Need

(2017-06) Transformers by Google

Finetuned Language Models are Zero-Shot Learners

(2021-09) FLAN by Google

Scaling Laws for Neural Language Models

(2020-01) Scaling Law by OpenAI

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

(2024-05) Mamba2 by CMU&Princeton

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

(2022-11) BLOOM by BigScience

Visual Instruction Tuning

(2023-04) LLaVA by UW–Madison&Microsoft

Leave a Reply

Your email address will not be published. Required fields are marked *