OPT: Open Pre-trained Transformer Language Models
Milestone Papers
OPT: Open Pre-trained Transformer Language Models

(2022-05) OPT by Meta

Paper
(2022-05) OPT by Meta

Relevant Sites

LaMDA: Language Models for Dialog Applications

(2022-01) LaMDA by Google

PaLM: Scaling Language Modeling with Pathways

(2022-04) PaLM by Google

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning

(2023-01) Flan 2022 Collection by Google

Improving Language Understanding by Generative Pre-Training

(2018-06) GPT 1.0 by OpenAI

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

(2018-10) BERT by Google

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

(2023-12) Mamba by CMU&Princeton

Leave a Reply

Your email address will not be published. Required fields are marked *