Generative AI framework built for researchers and PyTorch developers working on Large Language Models (LLMs), Multimodal Models (MMs), Automatic Speech Recognition (ASR), Text to Speech (TTS), and Computer Vision (CV) domains.

Efficient Training for Big Models.

A library for accelerating Transformer model training on NVIDIA GPUs.

veRL is a flexible and efficient RL framework for LLMs.

A Native-PyTorch Library for LLM Fine-tuning.

Ongoing research training transformer models at scale.