Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Milestone Papers
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

(2023-04) Pythia by EleutherAI et al.

Paper
(2023-04) Pythia by EleutherAI et al.

Relevant Sites

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

(2019-10) T5 by Google

Mistral 7B

(2023-10) Mistral 7B by Mistral

Language models are few-shot learners

(2020-05) GPT 3.0 by OpenAI

Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision

(2023-05) Dromedary by CMU et al.

Training language models to follow instructions with human feedback

(2022-03) InstructGPT by OpenAI

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

(2022-06) BIG-bench by Google

Leave a Reply

Your email address will not be published. Required fields are marked *