Holistic Evaluation of Language Models
Milestone Papers
Holistic Evaluation of Language Models

(2022-11) HELM by Stanford

Paper
(2022-11) HELM by Stanford

Relevant Sites

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

(2021-01) Switch Transformers by Google

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

(2018-10) BERT by Google

Galactica: A Large Language Model for Science

(2022-11) Galactica by Meta

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

(2021-12) Gopher by DeepMind

Scaling Instruction-Finetuned Language Models

(2022-10) Flan-T5/PaLM by Google

Using Deep and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

(2022-01) Megatron-Turing NLG by Microsoft&NVIDIA

Leave a Reply

Your email address will not be published. Required fields are marked *