NeMo Framework
Training Frameworks
NeMo Framework

Generative AI framework built for researchers and PyTorch developers working on Large Language Models (LLMs), Multimodal Models (MMs), Automatic Speech Recognition (ASR), Text to Speech (TTS), and Computer Vision (CV) domains.

GitHub
Generative AI framework built for researchers and PyTorch developers working on Large Language Models (LLMs), Multimodal Models (MMs), Automatic Speech Recognition (ASR), Text to Speech (TTS), and Computer Vision (CV) domains.

Relevant Sites

Transformer Engine 2,477

A library for accelerating Transformer model training on NVIDIA GPUs.

GPT-NeoX 7,225

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

Megatron-LM 12,569

Ongoing research training transformer models at scale.

maxtext 1,763

A simple, performant and scalable Jax LLM!

Colossal-AI 40,962

Making large AI models cheaper, faster, and more accessible.

Megatron-DeepSpeed 2,085

DeepSpeed version of NVIDIA's Megatron-LM that adds additional support for several features such as MoE model training, Curriculum Learning, 3D Parallelism, and others.

Leave a Reply

Your email address will not be published. Required fields are marked *