obstore
Decision gist · record as of 2026-08-14
Yes, if you need a unified, high-performance interface to multiple cloud storage backends. The permissive MIT license, active maintenance, lack of heavy Python dependencies, and strong async support make it a solid choice for cloud-native Python applications. Medium install friction (compiled wheels) is manageable on common platforms. No known vulnerabilities.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.10 or later.
- Compiled wheels available for most platforms, but installation may require a build environment on unsupported architectures.
- Medium install friction due to compiled Rust bindings, but wheels are available for many platforms including macOS, Linux, and Windows across multiple architectures.
License · maintenance · safety
permissive license (permissive) — Licensed under MIT (permissive), so you can use it freely in commercial and private projects without restriction.
last release 2026-06-25 (50 days)
0 known vulnerabilities (OSV.dev, 2026-08-14) · 10,520,170 downloads/mo, #1,447 on PyPI
Alternatives
Verify before relying
pip install obstore
import obstore
# Create S3 client and get object
store = obstore.S3Store()
data = store.get("s3://bucket/key")- Whether the 9x throughput claim vs fsspec and 2.8x vs aioboto3 holds across your specific workload and concurrency patterns.
- Whether Apache Arrow format support requires additional dependencies or configuration beyond what's listed.
What it is and what it does
obstore is a Rust-backed Python library that abstracts away the differences between cloud storage providers—S3, Google Cloud Storage, Azure Storage, and S3-compatible services—behind a single, type-hinted interface. It handles both synchronous and asynchronous operations, streaming data transfer, automatic multipart uploads for large files, and credential refresh, all with minimal Python dependencies (only typing-extensions at runtime).
The package is designed for high-throughput workloads where you need to interact with object storage from Python without the overhead of traditional clients. It exposes file-like APIs, integrates with fsspec, and can return list results as Apache Arrow tables for memory efficiency. Zero-copy data exchange via the buffer protocol minimizes overhead between Rust and Python.
Use it for
- Bulk download or upload of files from multiple cloud providers using a single API without provider-specific code.
- High-concurrency async workloads that need to fetch many small objects from S3 or compatible storage efficiently.
- Streaming large files from cloud storage to avoid loading entire objects into memory.
- Automated credential refresh in long-running applications that interact with expiring cloud credentials.
- Integration with geospatial or data science pipelines that read from cloud-hosted datasets via fsspec.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you need a unified, high-performance interface to multiple cloud storage backends.
The permissive MIT license, active maintenance, lack of heavy Python dependencies, and strong async support make it a solid choice for cloud-native Python applications. Medium install friction (compiled wheels) is manageable on common platforms. No known vulnerabilities.
Install
obstore on PyPI
Before you install
Medium install friction due to compiled Rust bindings, but wheels are available for many platforms including macOS, Linux, and Windows across multiple architectures. Active maintenance with a recent release.
Requires Python 3.10 or later. Compiled wheels available for most platforms, but installation may require a build environment on unsupported architectures.
License in practice
Licensed under MIT (permissive), so you can use it freely in commercial and private projects without restriction.
Quickstart
pip install obstore
import obstore
# Create S3 client and get object
store = obstore.S3Store()
data = store.get("s3://bucket/key")Verify before relying
- Whether the 9x throughput claim vs fsspec and 2.8x vs aioboto3 holds across your specific workload and concurrency patterns.
- Whether Apache Arrow format support requires additional dependencies or configuration beyond what's listed.
Package facts
| License | permissive license permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Medium. Platform-specific wheel |
| Runtime dependencies | 1 packagetyping-extensions |
| Maintenance | Actively maintained 50 days since the last release |
| First released | |
| Downloads | 10,520,170 / month, #1,447 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaFramework :: AsyncIOFramework :: FastAPIFramework :: aiohttpIntended Audience :: DevelopersIntended Audience :: Science/ResearchLicense :: OSI Approved :: MIT LicenseOperating System :: MacOSOperating System :: Microsoft :: WindowsOperating System :: UnixProgramming Language :: Python :: Implementation :: CPythonProgramming Language :: Python :: Implementation :: PyPyProgramming Language :: RustTopic :: InternetTyping :: Typed |
Evidence: obstore-0.11.0-cp310-cp310-macosx_10_12_x86_64.whl; obstore-0.11.0-cp310-cp310-macosx_11_0_arm64.whl; obstore-0.11.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl; obstore-0.11.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl; obstore-0.11.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl; obstore-0.11.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl; obstore-0.11.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl; obstore-0.11.0-cp310-cp310-manylinux_2_24_aarch64.whl; obstore-0.11.0-cp310-cp310-musllinux_1_2_aarch64.whl; obstore-0.11.0-cp310-cp310-musllinux_1_2_armv7l.whl; obstore-0.11.0-cp310-cp310-musllinux_1_2_i686.whl; obstore-0.11.0-cp310-cp310-musllinux_1_2_x86_64.whl; obstore-0.11.0-cp310-cp310-win_amd64.whl; obstore-0.11.0-cp311-abi3-macosx_10_12_x86_64.whl; obstore-0.11.0-cp311-abi3-macosx_11_0_arm64.whl; obstore-0.11.0-cp311-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whl; obstore-0.11.0-cp311-abi3-manylinux_2_17_i686.manylinux2014_i686.whl; obstore-0.11.0-cp311-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl; obstore-0.11.0-cp311-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whl; obstore-0.11.0-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “streaming uploads downloads”
- obstoreobstore provides a unified Python interface to Amazon S3, Google…
- django-private-storageProvides a Django storage backend that restricts file uploads and…
- wecom-aibot-python-sdkA Python SDK for WeChat Work (企业微信) AI bot that manages WebSocket…
Give your agent the search over MCP, or paste the wish link into any chat.
More Internet packages
Botocore provides low-level, data-driven access to Amazon Web Services APIs, serving as the foundation for the AWS CLI and boto3 libraries.
Install it if you need programmatic access to AWS services.
Provides an async client for AWS services using botocore and aiohttp, allowing you to call AWS APIs asynchronously within asyncio-based applications.
Install it if you need to call AWS services from async Python code; it is the standard way to do so.
Pydantic validates Python data structures against type hints, coercing and checking input at runtime to ensure it matches a declared schema.
Provides a platform-independent file locking mechanism to coordinate access to files across processes and threads.
FastAPI is a Python web framework for building REST APIs using type hints, with automatic request validation, serialization, and interactive API documentation.
Provides common Protocol Buffer message definitions used across Google Cloud APIs, enabling Python clients to interact with Google services.
See also obspec · s3fs · s3transfer · multi-storage-client · ibm-cos-sdk-s3transfer · minio · django-s3-storage · mosaicml-streaming · universal-pathlib · synapse-s3-storage-provider