Harness LLMs with Multi-Agent Programming

a toolkit for deploying and serving Large Language Models (LLMs).

Comprehensive set of tools for working with local LLMs for various tasks.

A high-throughput and low-latency inference and serving framework for LLMs and VLs

Confidently evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.