Skip to main content

SmolLM

text-generation

View on GitHub Official site
Llm Models Apache-2.0 Easy setup 161,911 stars

Overview

Description

SmolLM gives you powerful, compact AI models for text and vision that run efficiently on everyday devices, not just expensive cloud GPUs. SmolLM3 outperforms larger competitors like Llama 3.2 3B while staying fully open and customizable. The bottom line: enterprise-grade language and vision AI with complete control over deployment and data.

Technical scorecard

License

Apache-2.0

Commercial use

Yes

OpenAI-compatible API

No

REST API

No

Fine-tuning support

Yes

Quantization support

No

Docker available

No

GUI / no-code available

No

Telemetry

Unknown

Offline after setup

Yes

Data & Privacy

Does it send data online?

After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.

Does it store history?

Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.

License checks?

Commercial use is marked as allowed or likely allowed by the listed license.

Telemetry?

Unknown

Last verified: Jul 22, 2026. Maintainer verification should be treated as directory guidance, not legal advice.

🧮

Planning to deploy SmolLM?

Estimate exact GPU VRAM requirements, context limits, fine-tuning memory, and infrastructure costs for SmolLM before committing to hardware.

Calculate Hardware & GPU Sizing →

Setup & Installation

Easy

A developer can usually get this running with standard docs.

# Start with the official project repository
# https://huggingface.co/blog/smollm

Hardware Requirements

RAM 3.4 GB minimum / 5.1 GB recommended
Hardware tagsCPU, GPU (NVIDIA)
Model formats safetensors, ONNX
Languagesen

Works Well With