An interactive chat project that leverages Ollama/OpenAI/MistralAI LLMs for rapid understanding and navigation of GitHub code repository or compressed file resources.

A high-throughput and low-latency inference and serving framework for LLMs and VLs

Seamlessly integrate LLMs as Python functions

AI gateway and marketplace for developers, enables streamlined integration of AI features into products

Building applications with LLMs through composability

a toolkit for deploying and serving Large Language Models (LLMs).