opendal

What it is and what it does

OpenDAL is a Python binding to a Rust-based data access layer that unifies operations across many storage services—S3, GCS, Azure Blob Storage, local filesystem, and others. Instead of learning different APIs for each service, you configure an Operator with a service name and credentials, then use the same read, write, stat, and delete methods regardless of backend. The package ships with prebuilt wheels for most platforms and supports both synchronous and asynchronous APIs.

The abstraction is particularly useful when you need to support multiple storage backends in the same codebase, or when you want to switch backends without rewriting application logic. It's backed by Apache and actively maintained, with a Rust core ensuring performance-critical operations run efficiently.

Use it for:

• Build a data pipeline that reads from S3 in production but uses local filesystem in development without code changes.
• Write a backup tool that can target S3, GCS, or Azure Blob Storage with identical Python code.
• Implement async file operations across multiple cloud providers with a single unified API.
• Create a multi-tenant application where each tenant's storage backend is configured at runtime.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Provides unified Python access to multiple storage services (S3, GCS, Azure, local filesystem, and others) through a single API, abstracting away service-specific details.

Yes, if you need to support multiple storage backends or want a unified abstraction layer. The active maintenance, permissive license, zero vulnerabilities, and prebuilt wheels make it low-risk. Install friction is moderate due to Rust compilation, but wheels cover common platforms. Not necessary if you only use a single service and its native SDK is already familiar.

Install

opendal on PyPI

pip install opendal

uv add opendal

poetry add opendal

Installing opendal

Before you install

Medium install friction due to compiled Rust bindings, but prebuilt wheels cover common platforms (x86_64, ARM, Windows, macOS). Active maintenance with releases every 2–3 weeks; last commit 2026-08-14.

License in practice

Apache License 2.0 (permissive) allows commercial use, modification, and distribution with minimal restrictions; suitable for most projects.

Quickstart

pip install opendal

import opendal

op = opendal.Operator("fs", root="/tmp")
op.write("test.txt", b"Hello World")
print(op.read("test.txt"))

Requires Python ≥3.10; compiled Rust bindings may require a C compiler on platforms without prebuilt wheels.

Verify before relying

• Performance characteristics and throughput limits compared to direct service SDKs.
• Completeness of feature parity across all supported storage backends.
• Production readiness and stability guarantees for each backend service.

Package facts

Evidence: opendal-0.47.5-cp310-cp310-macosx_10_12_x86_64.whl; opendal-0.47.5-cp310-cp310-macosx_11_0_arm64.whl; opendal-0.47.5-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl; opendal-0.47.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl; opendal-0.47.5-cp310-cp310-manylinux_2_28_aarch64.whl; opendal-0.47.5-cp310-cp310-musllinux_1_1_aarch64.whl; opendal-0.47.5-cp310-cp310-musllinux_1_1_armv7l.whl; opendal-0.47.5-cp310-cp310-musllinux_1_1_x86_64.whl; opendal-0.47.5-cp310-cp310-win_amd64.whl; opendal-0.47.5-cp311-abi3-macosx_10_12_x86_64.whl; opendal-0.47.5-cp311-abi3-macosx_11_0_arm64.whl; opendal-0.47.5-cp311-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whl; opendal-0.47.5-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl; opendal-0.47.5-cp311-abi3-manylinux_2_28_aarch64.whl; opendal-0.47.5-cp311-abi3-musllinux_1_1_aarch64.whl; opendal-0.47.5-cp311-abi3-musllinux_1_1_armv7l.whl; opendal-0.47.5-cp311-abi3-musllinux_1_1_x86_64.whl; opendal-0.47.5-cp311-abi3-win_amd64.whl; opendal-0.47.5-cp314-cp314t-macosx_10_12_x86_64.whl; opendal-0.47.5-cp314-cp314t-macosx_11_0_arm64.whl

Tags

More Database packages