Language Models are Unsupervised Multitask Learners
Milestone Papers
Language Models are Unsupervised Multitask Learners

(2019-02) GPT 2.0 by OpenAI

Paper
(2019-02) GPT 2.0 by OpenAI

Relevant Sites

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

(2024-01) DeepSeek-v2 by DeepSeek

GPT-4 Technical Report

(2023-03) GPT 4 by OpenAI

Mistral 7B

(2023-10) Mistral 7B by Mistral

The Llama 3 Herd of Models

(2024-05) Llama3 by Meta

RWKV: Reinventing RNNs for the Transformer Era

(2023-05) RWKV by Bo Peng

Using Deep and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

(2022-01) Megatron-Turing NLG by Microsoft&NVIDIA

Leave a Reply

Your email address will not be published. Required fields are marked *