simplifies the evaluation of LLMs by providing a unified microservice to access and test multiple AI models.

SGLang is a fast serving framework for large language models and vision language models.

Open Source LLM Engineering Platform 🪢 Tracing, Evaluations, Prompt Management, Evaluations and Playground.

Inference for text-embeddings in Python

Easily build, version, evaluate and deploy your LLM-powered apps.

An interactive chat project that leverages Ollama/OpenAI/MistralAI LLMs for rapid understanding and navigation of GitHub code repository or compressed file resources.