Scaling Laws for Neural Language Models
Milestone Papers
Scaling Laws for Neural Language Models

(2020-01) Scaling Law by OpenAI

Paper
(2020-01) Scaling Law by OpenAI

Relevant Sites

Tree of Thoughts: Deliberate Problem Solving with Large Language Models

(2023-05) ToT by Google&Princeton

OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization

(2022-12) OPT-IML by Meta

RWKV: Reinventing RNNs for the Transformer Era

(2023-05) RWKV by Bo Peng

Qwen2.5 Technical Report

(2024-12) Qwen2.5 by Alibaba

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

(2022-06) BIG-bench by Google

Using Deep and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

(2022-01) Megatron-Turing NLG by Microsoft&NVIDIA

Leave a Reply

Your email address will not be published. Required fields are marked *