First LLM Multi-agent framework.

NVIDIA Framework for LLM Inference(Transitioned to TensorRT-LLM)

Easily build, version, evaluate and deploy your LLM-powered apps.

A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.

Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.

An interactive chat project that leverages Ollama/OpenAI/MistralAI LLMs for rapid understanding and navigation of GitHub code repository or compressed file resources.