Resurrecting Recurrent Neural Networks for Long Sequences
Milestone Papers
Resurrecting Recurrent Neural Networks for Long Sequences

(2023-03) LRU by DeepMind

Paper
(2023-03) LRU by DeepMind

Relevant Sites

OPT: Open Pre-trained Transformer Language Models

(2022-05) OPT by Meta

Multitask Prompted Training Enables Zero-Shot Task Generalization

(2021-10) T0 by HuggingFace et al.

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

(2021-12) Gopher by DeepMind

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

(2019-10) T5 by Google

An empirical analysis of compute-optimal large language model training

(2022-04) Chinchilla by DeepMind

Direct Preference Optimization: Your Language Model is Secretly a Reward Model

(2023-05) DPO by Stanford

Leave a Reply

Your email address will not be published. Required fields are marked *