OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Milestone Papers
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization

(2022-12) OPT-IML by Meta

Paper
(2022-12) OPT-IML by Meta

Relevant Sites

Using Deep and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

(2022-01) Megatron-Turing NLG by Microsoft&NVIDIA

Resurrecting Recurrent Neural Networks for Long Sequences

(2023-03) LRU by DeepMind

Language Models are Unsupervised Multitask Learners

(2019-02) GPT 2.0 by OpenAI

DeepSeek-R1 91,457

(2025-1) DeepSeek-R1 by DeepSeek

Attention Is All You Need

(2017-06) Transformers by Google

An empirical analysis of compute-optimal large language model training

(2022-04) Chinchilla by DeepMind

Leave a Reply

Your email address will not be published. Required fields are marked *