FastChat
Inference Engines
FastChat

A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.

GitHub
A distributed multi-model LLM serving system with web UI and OpenAI-compatible RESTful APIs.

Relevant Sites

Langroid 3,476

Harness LLMs with Multi-Agent Programming

QA-Pilot 293

An interactive chat project that leverages Ollama/OpenAI/MistralAI LLMs for rapid understanding and navigation of GitHub code repository or compressed file resources.

Langchain-Chatchat 35,607

Formerly langchain-ChatGLM, local knowledge based LLM (like ChatGLM) QA app with langchain.

Shell-Pilot 100

Interact with LLM using Ollama models(or openAI, mistralAI)via pure shell scripts on your Linux(or MacOS) system, enhancing intelligent system management without any dependencies.

Sidekick

Data integration platform for LLMs.

Text-Embeddings-Inference 3,801

Inference for text-embeddings in Rust, HFOIL Licence.

Leave a Reply

Your email address will not be published. Required fields are marked *