Create, deploy and operate Actions using Python anywhere to enhance your AI agents and assistants. Batteries included with an extensive set of libraries, helpers and logging.

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

simplifies the evaluation of LLMs by providing a unified microservice to access and test multiple AI models.

Build your own conversational search engine using less than 500 lines of code by LeptonAI.

Open Source LLM Engineering Platform 🪢 Tracing, Evaluations, Prompt Management, Evaluations and Playground.

Gateway streamlines requests to 100+ open & closed source models with a unified API. It is also production-ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency.