GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Milestone Papers
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

(2021-12) GLaM by Google

Paper
(2021-12) GLaM by Google

Relevant Sites

Visual Instruction Tuning

(2023-04) LLaVA by UW–Madison&Microsoft

The Llama 3 Herd of Models

(2024-05) Llama3 by Meta

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

(2022-01) COT by Google

OPT: Open Pre-trained Transformer Language Models

(2022-05) OPT by Meta

Multitask Prompted Training Enables Zero-Shot Task Generalization

(2021-10) T0 by HuggingFace et al.

GLM-130B: An Open Bilingual Pre-trained Model

(2022-10) GLM-130B by Tsinghua

Leave a Reply

Your email address will not be published. Required fields are marked *