Overview
Description
TabbyAPI lets you run powerful open-source LLMs on your own hardware with a simple API that works just like OpenAI's. It's built specifically for ExLlama models, giving you fast inference with features like tool calling, structured output, and concurrent users. The bottom line: get private, low-latency AI without depending on external services.
Technical scorecard
License
AGPL-3.0
Commercial use
Yes
OpenAI-compatible API
Yes
REST API
Yes
Fine-tuning support
No
Quantization support
No
Docker available
Yes
GUI / no-code available
No
Telemetry
None
Offline after setup
Yes
Data & Privacy
Does it send data online?
After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.
Does it store history?
Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.
License checks?
Commercial use is marked as allowed or likely allowed by the listed license.
Telemetry?
None
Last verified: Jul 22, 2026. Maintainer verification should be treated as directory guidance, not legal advice.
Deploying TabbyAPI in production?
Stop silent telemetry leaks before they trigger an unintended data leak. Get our Airgap Certainty Blueprint for TabbyAPI.
Request Privacy and Telemetry AuditSetup & Installation
A developer can usually get this running with standard docs.
# Start with the official project repository
# https://github.com/theroyallab/tabbyAPIHardware Requirements
Works Well With