Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Milestone Papers
Direct Preference Optimization: Your Language Model is Secretly a Reward Model

(2023-05) DPO by Stanford

Paper
(2023-05) DPO by Stanford

Relevant Sites

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

(2024-01) DeepSeek-v2 by DeepSeek

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

(2024-05) Mamba2 by CMU&Princeton

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning

(2023-01) Flan 2022 Collection by Google

GLM-130B: An Open Bilingual Pre-trained Model

(2022-10) GLM-130B by Tsinghua

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

(2021-12) GLaM by Google

Scaling Instruction-Finetuned Language Models

(2022-10) Flan-T5/PaLM by Google

Leave a Reply

Your email address will not be published. Required fields are marked *