Skip to main content

ncnn

ncnn is a high-performance neural network inference framework optimized for the mobile platform

View on GitHub Official site
Deployment Medium setup 23,564 stars

Overview

Description

Run AI models directly on mobile phones, desktops, and embedded devices without cloud servers. ncnn is the production-proven inference engine behind Tencent apps like WeChat and QQ — it delivers fast on-device AI with no external runtime dependencies. The bottom line: you can deploy deep learning models anywhere your application runs.

Technical scorecard

License

Not specified

Commercial use

No

OpenAI-compatible API

No

REST API

No

Fine-tuning support

No

Quantization support

Yes

Docker available

No

GUI / no-code available

No

Telemetry

Unknown

Offline after setup

Yes

Data & Privacy

Does it send data online?

After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.

Does it store history?

Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.

License checks?

The listed license needs review before commercial use.

Telemetry?

Unknown

Last verified: Jul 22, 2026. Maintainer verification should be treated as directory guidance, not legal advice.

🛡️

Deploying ncnn in production?

Stop silent telemetry leaks before they trigger an unintended data leak. Get our Airgap Certainty Blueprint for ncnn.

Request Privacy and Telemetry Audit

Setup & Installation

Medium

A developer can usually get this running with standard docs.

# Start with the official project repository
# https://github.com/Tencent/ncnn

Hardware Requirements

Hardware tagsCPU, GPU (NVIDIA), GPU (AMD), GPU (Apple Silicon), Edge Device
LanguagesC++, C

Works Well With