pyiceberg-core

What it is and what it does

Pyiceberg-core is a compiled extension that brings Rust performance to Apache Iceberg operations within Python. It is designed as an internal component of the pyiceberg library rather than a standalone tool, providing optimized implementations of core table format handling. The package ships as pre-built wheels for multiple platforms and architectures, minimizing installation complexity on supported systems.

This is not a user-facing library—it exists to accelerate pyiceberg's internal operations. If you are working with Iceberg tables in Python, you would typically install pyiceberg, which depends on this core package automatically. Direct installation is only necessary for development or when explicitly required by pyiceberg.

Use it for:

• Accelerating Iceberg table operations when using the pyiceberg library for data lake workflows
• Improving performance of table metadata and partition handling in Iceberg-backed data systems
• Supporting pyiceberg installations on systems where Rust compilation is unavailable or undesirable

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Provides a Rust-powered core implementation for Apache Iceberg table format operations in Python, intended as an internal dependency for the pyiceberg library.

Yes, if you are using pyiceberg—it will be installed automatically as a dependency. No, if you are looking for a standalone Iceberg tool; install pyiceberg instead. The package itself is not meant for direct use and offers no public API beyond what pyiceberg exposes.

Install

pyiceberg-core on PyPI

pip install pyiceberg-core

uv add pyiceberg-core

poetry add pyiceberg-core

Installing pyiceberg-core

Before you install

Medium install friction due to compiled Rust bindings; wheels are pre-built for common platforms (x86_64, ARM, macOS, Windows). Active maintenance with a recent release 13 days ago.

License in practice

Licensed under Apache License 2.0 (permissive), allowing commercial use and modification with standard attribution requirements.

Quickstart

pip install pyiceberg-core

# This is an internal dependency; direct usage is not typical.
# It is imported by pyiceberg for core table operations.

Requires Python 3.10 or later; compiled wheels available for x86_64, ARM, and macOS architectures.

Verify before relying

• Specific Rust-backed functionality exposed to Python users (API surface not detailed in excerpt)
• Performance characteristics compared to pure-Python alternatives
• Compatibility with specific Iceberg versions or table formats

Package facts

Evidence: pyiceberg_core-0.10.1-cp310-abi3-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl; pyiceberg_core-0.10.1-cp310-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whl; pyiceberg_core-0.10.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl; pyiceberg_core-0.10.1-cp310-abi3-manylinux_2_28_aarch64.whl; pyiceberg_core-0.10.1-cp310-abi3-win_amd64.whl

Tags

More Database packages