BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Milestone Papers
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

(2022-11) BLOOM by BigScience

Paper
(2022-11) BLOOM by BigScience

Relevant Sites

Direct Preference Optimization: Your Language Model is Secretly a Reward Model

(2023-05) DPO by Stanford

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

(2018-10) BERT by Google

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

(2021-01) Switch Transformers by Google

Unifying Language Learning Paradigms

(2022-05) UL2 by Google

RWKV: Reinventing RNNs for the Transformer Era

(2023-05) RWKV by Bo Peng

PaLM 2 Technical Report

(2023-05) PaLM 2 by Google

Leave a Reply

Your email address will not be published. Required fields are marked *