xrootd

What it is and what it does

XRootD is a Python interface to the XRootD distributed filesystem protocol, originally developed for High Energy Physics data access at SLAC and CERN. It enables transparent, fault-tolerant access to massive datasets stored across multiple remote storage resources—disk servers, tape libraries, and remote sites—regardless of underlying storage technology or location. The package wraps the core XRootD C++ client library, allowing Python applications to read, write, and manage files in XRootD clusters and federated storage systems.

The package is used primarily in scientific computing and large-scale data infrastructure, powering systems like EOS distributed filesystem and global CDN deployments. It supports multi-protocol communications, authentication, authorization, and integration with other storage systems. Installation via pip provides the Python bindings; the underlying XRootD client libraries may need to be installed separately through system package managers or conda.

Use it for:

• Access large datasets stored in XRootD clusters at research institutions like CERN or SLAC without managing protocol details.
• Build Python data pipelines that read from or write to EOS or other XRootD-backed storage systems.
• Integrate XRootD file operations into scientific analysis workflows and batch processing jobs.
• Implement fault-tolerant remote file transfers across geographically distributed storage nodes.
• Query and manage files in erasure-coded or replicated storage configurations via Python.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Provides Python bindings to XRootD, a high-performance distributed filesystem client for accessing data across remote storage resources with fault tolerance and transparent protocol handling.

Yes, if you need to access XRootD storage systems from Python and have the underlying XRootD client libraries available on your system. The package is actively maintained, has no known vulnerabilities, and is well-suited for scientific and high-performance computing workloads. Install friction is moderate due to compiled bindings and external dependencies, but wheels are available for common platforms and Python versions.

Install

xrootd on PyPI

pip install xrootd

uv add xrootd

poetry add xrootd

Installing xrootd

Before you install

Medium install friction due to compiled C++ bindings; wheels are available for modern Python versions on macOS and Linux, but the package requires the underlying XRootD daemon or client libraries to be present on the system.

License in practice

Licensed under LGPL-3.0-or-later (copyleft); derivative works and modifications must be distributed under compatible terms, and source code must be made available to users.

Quickstart

pip install xrootd

import XRootD.client as xrd
with xrd.File() as f:
    status, response = f.open('root://server.example.com//path/to/file')
    if status.ok:
        status, data = f.read()

The XRootD client library must be installed on your system (via dnf, apt, brew, or conda) before the Python bindings can function.

Verify before relying

• Whether the XRootD client library must be installed separately on the system before the Python bindings can function.
• Specific authentication and authorization mechanisms supported by the Python API.
• Performance characteristics and throughput limits for typical use cases.
• Whether pip install provides a complete working installation or requires additional system-level setup.

Package facts

Evidence: xrootd-6.1.1-cp310-cp310-macosx_15_0_arm64.whl; xrootd-6.1.1-cp310-cp310-macosx_15_0_x86_64.whl; xrootd-6.1.1-cp310-cp310-manylinux_2_28_aarch64.whl; xrootd-6.1.1-cp310-cp310-manylinux_2_28_x86_64.whl; xrootd-6.1.1-cp311-cp311-macosx_15_0_arm64.whl; xrootd-6.1.1-cp311-cp311-macosx_15_0_x86_64.whl; xrootd-6.1.1-cp311-cp311-manylinux_2_28_aarch64.whl; xrootd-6.1.1-cp311-cp311-manylinux_2_28_x86_64.whl; xrootd-6.1.1-cp312-cp312-macosx_15_0_arm64.whl; xrootd-6.1.1-cp312-cp312-macosx_15_0_x86_64.whl; xrootd-6.1.1-cp312-cp312-manylinux_2_28_aarch64.whl; xrootd-6.1.1-cp312-cp312-manylinux_2_28_x86_64.whl; xrootd-6.1.1-cp313-cp313-macosx_15_0_arm64.whl; xrootd-6.1.1-cp313-cp313-macosx_15_0_x86_64.whl; xrootd-6.1.1-cp313-cp313-manylinux_2_28_aarch64.whl; xrootd-6.1.1-cp313-cp313-manylinux_2_28_x86_64.whl; xrootd-6.1.1-cp314-cp314-macosx_15_0_arm64.whl; xrootd-6.1.1-cp314-cp314-macosx_15_0_x86_64.whl; xrootd-6.1.1-cp314-cp314-manylinux_2_28_aarch64.whl; xrootd-6.1.1-cp314-cp314-manylinux_2_28_x86_64.whl

Keywords: XRootD, network filesystem

Tags

More Distributed Computing packages