delta
An open-source storage framework for building Lakehouse architecture with various compute engines and APIs
GraphCanon updated 2w · GitHub synced 2w
Decision brief
Delta is an open-source storage framework providing ACID transactions for data lakehouse architectures designed to work seamlessly with various compute engines including Apache Spark, PrestoDB, Flink, Trino, and Hive.
Good fit when
- When you need ACID transaction support in a data lakehouse architecture leveraging Scala and multiple compute engines like Spark, Flink, or PrestoDB.
- If your project requires compatibility with APIs for diverse compute environments including the ones mentioned above.
Avoid when
- When your data operations environment is restricted to a single compute engine or one not supported by Delta, like Apache Drill which isn't in the listed support scope.
- If your project strictly uses open-source licenses incompatible with BSD-style licensing terms, as Delta uses Apache-2.0.
Observed Jul 15, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (1d since push)
- As of 2w
- Provenance
- Not a fork · Organization account
- As of 2w
- Security (OSV)
- No lockfile
- As of 1mo
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/delta-io/deltaSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Delta Lake provides ACID transactions on top of Apache Spark and other compute engines like PrestoDB, Flink, Trino, and Hive. It is implemented in Scala.
Capability facts
- Deploy
- Self-host
Source: dockerfile:Dockerfile · Aug 3, 2026
- Docker
- Dockerfile present
Source: dockerfile:Dockerfile · Aug 3, 2026
- Languages
- scala
Source: github.language · Aug 3, 2026
Categories
Tags
README
Requirements for Underlying Storage Systems
Delta Lake ACID guarantees are predicated on the atomicity and durability guarantees of the storage system. Specifically, we require the storage system to provide the following.
- Atomic visibility: There must be a way for a file to be visible in its entirety or not visible at all.
- Mutual exclusion: Only one writer must be able to create (or rename) a file at the final destination.
- Consistent listing: Once a file has been written in a directory, all future listings for that directory must return that file.
See the online documentation on Storage Configuration for details.
License
Apache License 2.0, see LICENSE.
For agents
This page has a .md twin and JSON over the API.