DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
Milestone Papers
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

(2024-01) DeepSeek-v2 by DeepSeek

Paper
(2024-01) DeepSeek-v2 by DeepSeek

Relevant Sites

Galactica: A Large Language Model for Science

(2022-11) Galactica by Meta

Evaluating Large Language Models Trained on Code

(2021-08) Codex by OpenAI

Language models are few-shot learners

(2020-05) GPT 3.0 by OpenAI

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

(2023-12) Mamba by CMU&Princeton

LLaMA: Open and Efficient Foundation Language Models

(2023-02) LLaMA by Meta

Improving language models by retrieving from trillions of tokens

(2021-12) Retro by DeepMind

Leave a Reply

Your email address will not be published. Required fields are marked *