PaLM: Scaling Language Modeling with Pathways
Milestone Papers
PaLM: Scaling Language Modeling with Pathways

(2022-04) PaLM by Google

Paper
(2022-04) PaLM by Google

Relevant Sites

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

(2019-09) Megatron-LM by NVIDIA

Resurrecting Recurrent Neural Networks for Long Sequences

(2023-03) LRU by DeepMind

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

(2023-12) Mamba by CMU&Princeton

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

(2022-06) BIG-bench by Google

LLaMA: Open and Efficient Foundation Language Models

(2023-02) LLaMA by Meta

Unifying Language Learning Paradigms

(2022-05) UL2 by Google

Leave a Reply

Your email address will not be published. Required fields are marked *