OPT: Open Pre-trained Transformer Language Models
Milestone Papers
OPT: Open Pre-trained Transformer Language Models

(2022-05) OPT by Meta

Paper
(2022-05) OPT by Meta

Relevant Sites

Finetuned Language Models are Zero-Shot Learners

(2021-09) FLAN by Google

Visual Instruction Tuning

(2023-04) LLaVA by UW–Madison&Microsoft

Galactica: A Large Language Model for Science

(2022-11) Galactica by Meta

PaLM: Scaling Language Modeling with Pathways

(2022-04) PaLM by Google

Qwen2.5 Technical Report

(2024-12) Qwen2.5 by Alibaba

Improving language models by retrieving from trillions of tokens

(2021-12) Retro by DeepMind

Leave a Reply

Your email address will not be published. Required fields are marked *