Making large AI models cheaper, faster, and more accessible.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

A library for accelerating Transformer model training on NVIDIA GPUs.

Mesh TensorFlow: Model Parallelism Made Easier.

A native PyTorch Library for large model training.