Skip to main content

Ollama

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

View on GitHub Official site
Llm Inference MIT Easy setup 176,623 stars

Overview

Description

Run hundreds of open-source AI models on your own hardware with zero cloud dependency. The big picture: download, install, and start chatting with models like Gemma, DeepSeek, Qwen, and Llama in minutes. Here's why it matters: no subscription, no API keys, and full data privacy — everything runs locally on your machine. The bottom line: a single binary that handles model management, inference, and API access so you and your team can experiment with AI without vendor lock-in.

Technical scorecard

License

MIT

Commercial use

Yes

OpenAI-compatible API

Yes

REST API

Yes

Fine-tuning support

No

Quantization support

Yes

Docker available

Yes

GUI / no-code available

Yes

Telemetry

Unknown

Offline after setup

Yes

Data & Privacy

Does it send data online?

After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.

Does it store history?

Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.

License checks?

Commercial use is marked as allowed or likely allowed by the listed license.

Telemetry?

Unknown

Last verified: Jul 22, 2026. Maintainer verification should be treated as directory guidance, not legal advice.

🛡️

Deploying Ollama in production?

Stop silent telemetry leaks before they trigger an unintended data leak. Get our Airgap Certainty Blueprint for Ollama.

Request Privacy and Telemetry Audit

Setup & Installation

Easy

A developer can usually get this running with standard docs.

# Start with the official project repository
# https://github.com/ollama/ollama

Hardware Requirements

Hardware tagsCPU, GPU (NVIDIA), GPU (Apple Silicon)
LanguagesGo, C

Works Well With