Build your own conversational search engine using less than 500 lines of code by LeptonAI.

Nvidia Framework for LLM Inference

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

Blazingly fast LLM inference.

Create, deploy and operate Actions using Python anywhere to enhance your AI agents and assistants. Batteries included with an extensive set of libraries, helpers and logging.

SGLang is a fast serving framework for large language models and vision language models.