Skip to main content

BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

View on GitHub Official site
Deployment Apache-2.0 Easy setup 8,730 stars

Overview

Description

Ship AI models as production-ready APIs in minutes. BentoML turns any model into a scalable REST or gRPC endpoint with just a few lines of Python — no infrastructure expertise required. The bottom line: you focus on model logic, BentoML handles serving, batching, Docker packaging, and cloud deployment.

Technical scorecard

License

Apache-2.0

Commercial use

Yes

OpenAI-compatible API

No

REST API

Yes

Fine-tuning support

No

Quantization support

No

Docker available

Yes

GUI / no-code available

No

Telemetry

Opt-out

Offline after setup

No

Data & Privacy

Does it send data online?

This listing is not marked offline after setup.

Does it store history?

Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.

License checks?

Commercial use is marked as allowed or likely allowed by the listed license.

Telemetry?

Opt-out

Last verified: Jul 22, 2026. Maintainer verification should be treated as directory guidance, not legal advice.

🛡️

Deploying BentoML in production?

Stop silent telemetry leaks before they trigger an unintended data leak. Get our Airgap Certainty Blueprint for BentoML.

Request Privacy and Telemetry Audit

Setup & Installation

Easy

A developer can usually get this running with standard docs.

# Start with the official project repository
# https://github.com/bentoml/BentoML

Hardware Requirements

Hardware tagsCPU, GPU (NVIDIA)
LanguagesPython

Works Well With