Mistral 7B
Milestone Papers
Mistral 7B

(2023-10) Mistral 7B by Mistral

Paper
(2023-10) Mistral 7B by Mistral

Relevant Sites

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

(2019-09) Megatron-LM by NVIDIA

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

(2024-05) Mamba2 by CMU&Princeton

Unifying Language Learning Paradigms

(2022-05) UL2 by Google

PaLM: Scaling Language Modeling with Pathways

(2022-04) PaLM by Google

Scaling Instruction-Finetuned Language Models

(2022-10) Flan-T5/PaLM by Google

Resurrecting Recurrent Neural Networks for Long Sequences

(2023-03) LRU by DeepMind

Leave a Reply

Your email address will not be published. Required fields are marked *