veRL is a flexible and efficient RL framework for LLMs.

A simple, performant and scalable Jax LLM!

Ongoing research training transformer models at scale.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

A native PyTorch Library for large model training.

Efficient Training for Big Models.