DeepSpeed | LLMWay – The Way To LLM

Training Frameworks

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

GitHub

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Transformer Engine 2,269

A library for accelerating Transformer model training on NVIDIA GPUs.

veRL 4,759

veRL is a flexible and efficient RL framework for LLMs.

torchtitan 3,445

A native PyTorch Library for large model training.

BMTrain 580

Efficient Training for Big Models.

maxtext 1,651

A simple, performant and scalable Jax LLM!

GPT-NeoX 7,129

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.