Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Milestone Papers
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

(2023-04) Pythia by EleutherAI et al.

Paper
(2023-04) Pythia by EleutherAI et al.

Relevant Sites

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

(2024-05) Mamba2 by CMU&Princeton

Evaluating Large Language Models Trained on Code

(2021-08) Codex by OpenAI

PaLM-E: An Embodied Multimodal Language Model

(2023-03) PaLM-E by Google

Training language models to follow instructions with human feedback

(2022-03) InstructGPT by OpenAI

Improving Language Understanding by Generative Pre-Training

(2018-06) GPT 1.0 by OpenAI

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

(2019-10) T5 by Google

Leave a Reply

Your email address will not be published. Required fields are marked *