Resurrecting Recurrent Neural Networks for Long Sequences
Milestone Papers
Resurrecting Recurrent Neural Networks for Long Sequences

(2023-03) LRU by DeepMind

Paper
(2023-03) LRU by DeepMind

Relevant Sites

Improving language models by retrieving from trillions of tokens

(2021-12) Retro by DeepMind

Language models are few-shot learners

(2020-05) GPT 3.0 by OpenAI

PaLM 2 Technical Report

(2023-05) PaLM 2 by Google

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

(2023-12) Mamba by CMU&Princeton

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

(2022-11) BLOOM by BigScience

Direct Preference Optimization: Your Language Model is Secretly a Reward Model

(2023-05) DPO by Stanford

Leave a Reply

Your email address will not be published. Required fields are marked *