Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Milestone Papers
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

(2023-04) Pythia by EleutherAI et al.

Paper
(2023-04) Pythia by EleutherAI et al.

Relevant Sites

Language Models are General-Purpose Interfaces

(2022-06) METALM by Microsoft

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

(2024-05) Mamba2 by CMU&Princeton

The Llama 3 Herd of Models

(2024-05) Llama3 by Meta

Emergent Abilities of Large Language Models

(2022-06) Emergent Abilities by Google

Llama 2: Open Foundation and Fine-Tuned Chat Models

(2023-07) LLaMA2 by Meta

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

(2019-09) Megatron-LM by NVIDIA

Leave a Reply

Your email address will not be published. Required fields are marked *