OPT: Open Pre-trained Transformer Language Models
Milestone Papers
OPT: Open Pre-trained Transformer Language Models

(2022-05) OPT by Meta

Paper
(2022-05) OPT by Meta

Relevant Sites

Unifying Language Learning Paradigms

(2022-05) UL2 by Google

PaLM-E: An Embodied Multimodal Language Model

(2023-03) PaLM-E by Google

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

(2021-12) GLaM by Google

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

(2019-10) T5 by Google

Scaling Instruction-Finetuned Language Models

(2022-10) Flan-T5/PaLM by Google

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

(2024-01) DeepSeek-v2 by DeepSeek

Leave a Reply

Your email address will not be published. Required fields are marked *