Skip to main content

LLMFarm

llama and other large language models on iOS and MacOS offline using GGML library.

View on GitHub Official site
Chat Interfaces MIT 2,049 stars

Overview

Description

The big picture: Run powerful AI language models directly on your iPhone, iPad, or Mac — completely offline with no internet connection needed. Here's why it matters: You can test, compare, and run dozens of models privately on your own device without sending data to the cloud. The bottom line: private, on-device AI that works anywhere.

Technical scorecard

License

MIT

Commercial use

Yes

OpenAI-compatible API

No

REST API

No

Fine-tuning support

No

Quantization support

Yes

Docker available

No

GUI / no-code available

Yes

Telemetry

Unknown

Offline after setup

Yes

Data & Privacy

Does it send data online?

After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.

Does it store history?

Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.

License checks?

Commercial use is marked as allowed or likely allowed by the listed license.

Telemetry?

Unknown

Last verified: Jul 22, 2026. Maintainer verification should be treated as directory guidance, not legal advice.

🛡️

Deploying LLMFarm in production?

Stop silent telemetry leaks before they trigger an unintended data leak. Get our Airgap Certainty Blueprint for LLMFarm.

Request Privacy and Telemetry Audit

Setup & Installation

A developer can usually get this running with standard docs.

# Start with the official project repository
# https://github.com/guinmoon/LLMFarm

Hardware Requirements

Hardware tagsCPU, GPU (Apple Silicon), Edge Device
LanguagesC, Swift, C++

Works Well With