A native PyTorch Library for large model training.
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
Making large AI models cheaper, faster, and more accessible.
A Native-PyTorch Library for LLM Fine-tuning.
A simple, performant and scalable Jax LLM!
Ongoing research training transformer models at scale.
Mesh TensorFlow: Model Parallelism Made Easier.
Your email address will not be published. Required fields are marked *
Comment *
Name *
Email *
Website
Captcha: 15 + 11 = ?*
Save my name, email, and website in this browser for the next time I comment.
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.