Scaling Laws for Neural Language Models
Milestone Papers
Scaling Laws for Neural Language Models

(2020-01) Scaling Law by OpenAI

Paper
(2020-01) Scaling Law by OpenAI

Relevant Sites

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

(2024-01) DeepSeek-v2 by DeepSeek

On the Opportunities and Risks of Foundation Models

(2021-08) Foundation Models by Stanford

Language Models are Unsupervised Multitask Learners

(2019-02) GPT 2.0 by OpenAI

An empirical analysis of compute-optimal large language model training

(2022-04) Chinchilla by DeepMind

Visual Instruction Tuning

(2023-04) LLaVA by UW–Madison&Microsoft

PaLM 2 Technical Report

(2023-05) PaLM 2 by Google

Leave a Reply

Your email address will not be published. Required fields are marked *