Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Milestone Papers
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

(2023-04) Pythia by EleutherAI et al.

Paper
(2023-04) Pythia by EleutherAI et al.

Relevant Sites

Mistral 7B

(2023-10) Mistral 7B by Mistral

Resurrecting Recurrent Neural Networks for Long Sequences

(2023-03) LRU by DeepMind

Holistic Evaluation of Language Models

(2022-11) HELM by Stanford

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

(2024-05) Mamba2 by CMU&Princeton

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

(2024-01) DeepSeek-v2 by DeepSeek

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

(2021-12) Gopher by DeepMind

Leave a Reply

Your email address will not be published. Required fields are marked *