Scaling Laws for Neural Language Models
Milestone Papers
Scaling Laws for Neural Language Models

(2020-01) Scaling Law by OpenAI

Paper
(2020-01) Scaling Law by OpenAI

Relevant Sites

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning

(2023-01) Flan 2022 Collection by Google

Language Models are Unsupervised Multitask Learners

(2019-02) GPT 2.0 by OpenAI

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

(2021-12) Gopher by DeepMind

Qwen2.5 Technical Report

(2024-12) Qwen2.5 by Alibaba

PaLM 2 Technical Report

(2023-05) PaLM 2 by Google

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

(2024-01) DeepSeek-v2 by DeepSeek

Leave a Reply

Your email address will not be published. Required fields are marked *