Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Milestone Papers
Mamba: Linear-Time Sequence Modeling with Selective State Spaces

(2023-12) Mamba by CMU&Princeton

Paper
(2023-12) Mamba by CMU&Princeton

Relevant Sites

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning

(2023-01) Flan 2022 Collection by Google

PaLM-E: An Embodied Multimodal Language Model

(2023-03) PaLM-E by Google

GLM-130B: An Open Bilingual Pre-trained Model

(2022-10) GLM-130B by Tsinghua

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

(2023-04) Pythia by EleutherAI et al.

Direct Preference Optimization: Your Language Model is Secretly a Reward Model

(2023-05) DPO by Stanford

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

(2021-12) GLaM by Google

Leave a Reply

Your email address will not be published. Required fields are marked *