Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Milestone Papers
Direct Preference Optimization: Your Language Model is Secretly a Reward Model

(2023-05) DPO by Stanford

Paper
(2023-05) DPO by Stanford

Relevant Sites

LLaMA: Open and Efficient Foundation Language Models

(2023-02) LLaMA by Meta

Training language models to follow instructions with human feedback

(2022-03) InstructGPT by OpenAI

Unifying Language Learning Paradigms

(2022-05) UL2 by Google

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

(2019-09) Megatron-LM by NVIDIA

Using Deep and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

(2022-01) Megatron-Turing NLG by Microsoft&NVIDIA

Galactica: A Large Language Model for Science

(2022-11) Galactica by Meta

Leave a Reply

Your email address will not be published. Required fields are marked *