Language Models are Unsupervised Multitask Learners
Milestone Papers
Language Models are Unsupervised Multitask Learners

(2019-02) GPT 2.0 by OpenAI

Paper
(2019-02) GPT 2.0 by OpenAI

Relevant Sites

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

(2024-01) DeepSeek-v2 by DeepSeek

Galactica: A Large Language Model for Science

(2022-11) Galactica by Meta

An empirical analysis of compute-optimal large language model training

(2022-04) Chinchilla by DeepMind

Solving Quantitative Reasoning Problems with Language Models

(2022-01) Minerva by Google

Multitask Prompted Training Enables Zero-Shot Task Generalization

(2021-10) T0 by HuggingFace et al.

Scaling Laws for Neural Language Models

(2020-01) Scaling Law by OpenAI

Leave a Reply

Your email address will not be published. Required fields are marked *