Shell-Pilot
Inference Engines
Shell-Pilot

Interact with LLM using Ollama models(or openAI, mistralAI)via pure shell scripts on your Linux(or MacOS) system, enhancing intelligent system management without any dependencies.

GitHub
Interact with LLM using Ollama models(or openAI, mistralAI)via pure shell scripts on your Linux(or MacOS) system, enhancing intelligent system management without any dependencies.

Relevant Sites

Swiss Army Llama 1,029

Comprehensive set of tools for working with local LLMs for various tasks.

SkyPilot 8,715

Run LLMs and batch jobs on any cloud. Get maximum cost savings, highest GPU availability, and managed execution -- all with a simple interface.

GPUStack 3,692

An open-source GPU cluster manager for running LLMs

mistral.rs 6,077

Blazingly fast LLM inference.

Serge 5,750

a chat interface crafted with llama.cpp for running Alpaca models. No API keys, entirely self-hosted!

Agenta 3,151

Easily build, version, evaluate and deploy your LLM-powered apps.

Leave a Reply

Your email address will not be published. Required fields are marked *