Skip to main content

Apache Spark

Apache Spark - A unified analytics engine for large-scale data processing

View on GitHub Official site
Data Utilities Apache-2.0 Medium setup 43,670 stars

Overview

Description

Apache Spark processes massive datasets at lightning speed, turning raw data into actionable business insights. It handles SQL analytics, machine learning, real-time stream processing, and graph analysis in a single unified platform. The bottom line: Make faster, data-driven decisions without waiting hours for batch jobs to finish.

Technical scorecard

License

Apache-2.0

Commercial use

Yes

OpenAI-compatible API

No

REST API

No

Fine-tuning support

No

Quantization support

No

Docker available

Yes

GUI / no-code available

No

Telemetry

Unknown

Offline after setup

Yes

Data & Privacy

Does it send data online?

After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.

Does it store history?

Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.

License checks?

Commercial use is marked as allowed or likely allowed by the listed license.

Telemetry?

Unknown

Last verified: Jul 22, 2026. Maintainer verification should be treated as directory guidance, not legal advice.

🛡️

Deploying Apache Spark in production?

Stop silent telemetry leaks before they trigger an unintended data leak. Get our Airgap Certainty Blueprint for Apache Spark.

Request Privacy and Telemetry Audit

Setup & Installation

Medium

A developer can usually get this running with standard docs.

# Start with the official project repository
# https://github.com/apache/spark

Hardware Requirements

Hardware tagsNot specified
LanguagesScala

Works Well With