LLM Harbor
LLM Harbor is a TypeScript-based application that provides containerized LLM toolkit. Run LLM backends.
Overview
One command brings a complete pre-wired LLM stack with hundreds of services to explore. https://github.com/user-attachments/assets/8a7705e1-6f0e-4374-8784-62b95816aebc The project has 3K+ GitHub stars and is licensed under Apache-2.0.
Getting Started
Source: GitHub README
harbor logs llamacpp harbor exec llamacpp ./scripts/llama-bench —help harbor shell vllm
Normalized Features
Source: tool-features-normalized.json
docker, docker compose, plugins, rest api.
Deploy
Features
Integrations & APIs
- Plugin / Extension System
- REST API
Category
Related AI & Machine Learning Tools
View all 93 →OpenClaw
320KPersonal AI assistant you run on your own devices. 25+ messaging channels, voice, cron jobs, browser control, and a skills system.
Ollama
166KRun open-source LLMs locally — get up and running with DeepSeek, Qwen, Gemma, Llama, and more with a single command.
Open WebUI
128KRun AI on your own terms. Connect any model, extend with code, protect what matters—without compromise.
OpenCode
124KThe open-source AI coding agent — free models included, or connect Claude, GPT, Gemini, and 75+ other providers.
Zed
77KA high-performance code editor built from scratch in Rust by the creators of Atom — GPU-accelerated rendering, built-in AI, real-time multiplayer, and no Electron.
OpenHands
69KThe open-source, model-agnostic platform for cloud coding agents — automate real software engineering tasks with sandboxed execution, SDK, CLI, and enterprise-grade security.