Inference for text-embeddings in Rust, HFOIL Licence.

A high-throughput and memory-efficient inference and serving engine for LLMs.

Build your own conversational search engine using less than 500 lines of code by LeptonAI.

A high-throughput and low-latency inference and serving framework for LLMs and VLs

Run LLMs and batch jobs on any cloud. Get maximum cost savings, highest GPU availability, and managed execution -- all with a simple interface.

Locally running websearch using LLM chains