Harness LLMs with Multi-Agent Programming

A python package for Txt-to-SQL with self hosting functionalities and RESTful APIs compatible with proprietary as well as open source LLM.

MII makes low-latency and high-throughput inference, similar to vLLM powered by DeepSpeed.

First LLM Multi-agent framework.

Create, deploy and operate Actions using Python anywhere to enhance your AI agents and assistants. Batteries included with an extensive set of libraries, helpers and logging.

Inference for text-embeddings in Rust, HFOIL Licence.