Interact with LLM using Ollama models(or openAI, mistralAI)via pure shell scripts on your Linux(or MacOS) system, enhancing intelligent system management without any dependencies.

a toolkit for deploying and serving Large Language Models (LLMs).

An open-source GPU cluster manager for running LLMs

Playground for devs to finetune & deploy LLMs

SGLang is a fast serving framework for large language models and vision language models.

Seamlessly integrate LLMs as Python functions