talkd.ai dialog | LLMWay – The Way To LLM

Inference Engines

talkd.ai dialog

Simple API for deploying any RAG or LLM that you want adding plugins.

GitHub

Simple API for deploying any RAG or LLM that you want adding plugins.

GPUStack 3,082

An open-source GPU cluster manager for running LLMs

Agenta 2,935

Easily build, version, evaluate and deploy your LLM-powered apps.

Infinity 2,311

Inference for text-embeddings in Python

Embedchain 36,907

Framework to create ChatGPT like bots over your dataset.

mistral.rs 5,890

Blazingly fast LLM inference.

Search with Lepton 8,128

Build your own conversational search engine using less than 500 lines of code by LeptonAI.