hops-deltalake
Native Delta Lake Python binding based on delta-rs with Pandas integration
Decision gist · record as of 2026-08-14
Yes, if you need Delta Lake support in Python without Spark and your platform is macOS arm64 or Linux x86_64. The package is actively maintained, has no known vulnerabilities, and offers a lightweight alternative to Spark for Delta Lake operations. Install friction is moderate due to compiled wheels, but prebuilt binaries eliminate build overhead on supported platforms. Not recommended if you require other architectures or older Python versions.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python ≥3.10.
- Prebuilt wheels available for macOS arm64 and manylinux x86_64; other platforms may require Rust compiler and maturin to build from source.
- Active maintenance with recent releases.
License · maintenance · safety
permissive license (permissive) — Licensed under Apache Software License (permissive), allowing commercial and private use with minimal restrictions.
last release 2026-05-29 (77 days) · last repo commit 2026-05-29
0 known vulnerabilities (OSV.dev, 2026-08-14) · 82,813 downloads/mo, #14,132 on PyPI
Alternatives
Verify before relying
pip install hops-deltalake
from deltalake import DeltaTable
dt = DeltaTable("path/to/delta/table")
df = dt.to_pandas()- Whether HopsFS integration is required for typical use or optional for standard Delta Lake workflows.
- Performance characteristics and scalability limits compared to upstream delta-rs or Apache Spark Delta Lake.
- Stability and feature parity with the upstream delta-rs project given the HopsFS fork.
What it is and what it does
hops-deltalake is a Python binding to delta-rs, the Rust implementation of Delta Lake, with built-in support for HopsFS and Pandas. It lets you read and write Delta Lake tables—the ACID-compliant data lake format built on Parquet—directly from Python without requiring Spark or Java. The package handles table versioning, file URI resolution, and conversion to Pandas DataFrames, making it suitable for data engineering workflows that need Delta Lake semantics in a lightweight Python environment.
The package is maintained as a HopsFS-compatible fork and ships prebuilt wheels for modern Python versions (3.10–3.14) on macOS arm64 and manylinux x86_64. It includes OpenTelemetry tracing support for observability. Installation is straightforward via pip on supported platforms; other architectures require a Rust compiler and maturin to build custom wheels.
Use it for
- Read Delta Lake tables stored on S3 or HopsFS into Pandas for analysis and transformation.
- Write Pandas DataFrames as versioned Delta Lake tables with ACID guarantees and schema enforcement.
- Query Delta Lake table metadata (version history, file URIs, schema) without loading data into memory.
- Integrate Delta Lake into Python data pipelines running outside Spark or Hadoop ecosystems.
- Debug and inspect Delta Lake table structure and contents using Python for development and testing.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you need Delta Lake support in Python without Spark and your platform is macOS arm64 or Linux x86_64.
The package is actively maintained, has no known vulnerabilities, and offers a lightweight alternative to Spark for Delta Lake operations. Install friction is moderate due to compiled wheels, but prebuilt binaries eliminate build overhead on supported platforms. Not recommended if you require other architectures or older Python versions.
Install
hops-deltalake on PyPI
Before you install
Active maintenance with recent releases. Medium install friction due to compiled wheels (abi3 binaries for macOS arm64 and manylinux); prebuilt wheels available for Python 3.10–3.14, reducing build-from-source burden on supported platforms.
Requires Python ≥3.10. Prebuilt wheels available for macOS arm64 and manylinux x86_64; other platforms may require Rust compiler and maturin to build from source.
License in practice
Licensed under Apache Software License (permissive), allowing commercial and private use with minimal restrictions.
Quickstart
pip install hops-deltalake
from deltalake import DeltaTable
dt = DeltaTable("path/to/delta/table")
df = dt.to_pandas()Verify before relying
- Whether HopsFS integration is required for typical use or optional for standard Delta Lake workflows.
- Performance characteristics and scalability limits compared to upstream delta-rs or Apache Spark Delta Lake.
- Stability and feature parity with the upstream delta-rs project given the HopsFS fork.
Package facts
| License | permissive license permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Medium. Platform-specific wheel |
| Runtime dependencies | 2 packagesarro3-coredeprecated |
| Maintenance | Actively maintained 77 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 82,813 / month, #14,132 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | License :: OSI Approved :: Apache Software LicenseProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14 |
Evidence: hops_deltalake-1.4.0.post121-cp310-abi3-macosx_11_0_arm64.whl; hops_deltalake-1.4.0.post121-cp310-abi3-manylinux_2_28_x86_64.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “read write parquet delta tables”
- hops-deltalakeReads and writes Delta Lake tables with native Python bindings backed…
- deltalakeDeltalake provides native Python bindings to Delta Lake, enabling you…
- delta-sharingDelta Sharing is a Python client library for the Delta Sharing…
Give your agent the search over MCP, or paste the wish link into any chat.
More Database packages
psycopg2-binary is a PostgreSQL database adapter for Python that implements the DB API 2.0 specification, enabling Python applications to connect to and query PostgreSQL databases with thread-safe concurrent operations.
Python client library for connecting to and executing commands against Redis key-value stores, supporting both synchronous and asynchronous operations.
Install it if your application needs to interact with Redis; the only prerequisite is a running Redis server instance.
YDB Python SDK is the official client library for connecting to and querying YDB databases from Python applications.
Install it if you need to connect Python applications to YDB databases.
Connects Python applications to Snowflake data warehouses using the DB API 2.0 specification, enabling SQL queries, data transfers, and warehouse operations.
sqlparse tokenizes SQL text into a tree of statements, clauses, and expressions, and provides functions to split scripts, format queries, and inspect parsed tokens without validating dialect or syntax.
Install it if you need to manipulate, format, or analyze SQL text programmatically.
Provides base adapter protocols and shared functionality that database adapters use to integrate with dbt-core, handling connections, dialect translation, relation caching, and core interface management.
See also deltalake · deltalite · delta-kernel-rust-sharing-wrapper · delta-sharing · delta-spark · pyarrowfs-adlgen2 · mltable · pipelinewise-singer-python · datafusion · awswrangler