GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Milestone Papers
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

(2021-12) GLaM by Google

Paper
(2021-12) GLaM by Google

Relevant Sites

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

(2023-12) Mamba by CMU&Princeton

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

(2018-10) BERT by Google

Qwen2.5 Technical Report

(2024-12) Qwen2.5 by Alibaba

Holistic Evaluation of Language Models

(2022-11) HELM by Stanford

Language Models are Unsupervised Multitask Learners

(2019-02) GPT 2.0 by OpenAI

The Llama 3 Herd of Models

(2024-05) Llama3 by Meta

Leave a Reply

Your email address will not be published. Required fields are marked *