
Inference Engines
talkd.ai dialog
Simple API for deploying any RAG or LLM that you want adding plugins.
Simple API for deploying any RAG or LLM that you want adding plugins.
A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.