veRL is a flexible and efficient RL framework for LLMs.

A native PyTorch Library for large model training.

Generative AI framework built for researchers and PyTorch developers working on Large Language Models (LLMs), Multimodal Models (MMs), Automatic Speech Recognition (ASR), Text to Speech (TTS), and Computer Vision (CV) domains.

Mesh TensorFlow: Model Parallelism Made Easier.

Making large AI models cheaper, faster, and more accessible.

Ongoing research training transformer models at scale.