--- id: delta-spark version: "4.3.1" license: Apache-2.0 license_treatment: permissive maintenance: active --- # delta-spark — Python APIs for using Delta Lake with Apache Spark License: permissive · Maintenance: active · Popularity: top 1,000 on PyPI ## Install pip install delta-spark uv add delta-spark poetry add delta-spark ## Description # Delta Lake [Delta Lake](https://delta.io) is an open source storage layer that brings reliability to data lakes. Delta Lake provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing. Delta Lake runs on top of your existing data lake and is fully compatible with Apache Spark APIs. This PyPi package contains the Python APIs for using Delta Lake with Apache Spark. ## Installation and usage 1. Install using `pip install delta-spark` 2. To use the Delta Lake with Apache Spark, you have to set additional configurations when creating the SparkSession. See the online [project web page](https://docs.delta.io/latest/delta-intro.html) for details. ## Documentation This README file only contains basic information related to pip installed Delta Lake. You can find the full documentation on the [project web page](https://docs.delta.io/latest/delta-intro.html) ## AI interpretation — verify before relying Delta Lake provides ACID transactions and unified streaming/batch processing on top of Apache Spark, bringing reliability and metadata handling to data lakes. Verdict: Production-stable Delta Lake integration for Spark with active maintenance, permissive licensing, and low install friction. No known vulnerabilities and well-established in the top 1000 PyPI packages. Suitable for reliable data lake workloads requiring ACID guarantees. [View on SkillFed](https://skillfed.io/packages/delta-spark) · [View on PyPI](https://pypi.org/project/delta-spark/)