s3fs
Convenient Filesystem interface over S3
Decision gist · record as of 2026-08-14
Yes. s3fs is a mature, actively maintained library in the top 100 PyPI packages with no known vulnerabilities, low install friction, and permissive licensing. Install it if you need filesystem-like access to S3 from Python; the standard file interface will be more intuitive than raw boto3 calls for most use cases.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires AWS credentials configured (via environment variables, IAM role, or AWS config file) for S3 access.
- Installation is low-friction; the package is actively maintained with a recent release (17 days old) and depends on well-established async libraries (aiobotocore, fsspec, aiohttp).
- The repository shows consistent activity and community support.
License · maintenance · safety
BSD (permissive) — BSD license is permissive, allowing commercial and private use with minimal restrictions—suitable for most projects.
last release 2026-07-28 (17 days) · last repo commit 2026-08-13 · 1,046 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 704,379,780 downloads/mo, #45 on PyPI
Alternatives
Verify before relying
pip install s3fs
import s3fs
fs = s3fs.S3FileSystem()
with fs.open('s3://bucket/key', 'r') as f:
data = f.read()- Whether aiobotocore version constraints or AWS SDK compatibility issues affect specific deployment environments.
- Performance characteristics and concurrency limits when handling large-scale or high-frequency S3 operations.
What it is and what it does
s3fs is a Python library that wraps Amazon S3 storage behind a standard filesystem-like interface, built on top of aiobotocore. Instead of writing S3-specific code using boto calls, you can use familiar Python file operations (open, read, write, list) directly against S3 buckets and objects. It abstracts away the details of S3 API calls and authentication, making S3 feel like a mounted filesystem.
The package is designed for developers who need to integrate S3 storage into Python applications without learning the full boto3 API. It supports both synchronous and asynchronous workflows through its underlying async foundation, and integrates with the fsspec ecosystem for broader filesystem abstraction. The library is actively maintained, supports modern Python versions (3.10 through 3.14), and carries no known security vulnerabilities.
Use it for
- Reading and writing data files directly from S3 in data processing pipelines without downloading to local disk.
- Building cloud-native applications that treat S3 as a primary data store with standard file-like access patterns.
- Migrating code that works with local filesystems to work with S3 with minimal changes to file I/O logic.
- Listing and navigating S3 bucket contents programmatically as if browsing a directory tree.
- Integrating S3 storage into machine learning workflows where data lives in cloud buckets.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes.
s3fs is a mature, actively maintained library in the top 100 PyPI packages with no known vulnerabilities, low install friction, and permissive licensing. Install it if you need filesystem-like access to S3 from Python; the standard file interface will be more intuitive than raw boto3 calls for most use cases.
Install
s3fs on PyPI
Before you install
Installation is low-friction; the package is actively maintained with a recent release (17 days old) and depends on well-established async libraries (aiobotocore, fsspec, aiohttp). The repository shows consistent activity and community support.
Requires AWS credentials configured (via environment variables, IAM role, or AWS config file) for S3 access.
License in practice
BSD license is permissive, allowing commercial and private use with minimal restrictions—suitable for most projects.
Quickstart
pip install s3fs
import s3fs
fs = s3fs.S3FileSystem()
with fs.open('s3://bucket/key', 'r') as f:
data = f.read()Verify before relying
- Whether aiobotocore version constraints or AWS SDK compatibility issues affect specific deployment environments.
- Performance characteristics and concurrency limits when handling large-scale or high-frequency S3 operations.
Package facts
| License | BSD permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 3 packagesaiobotocorefsspecaiohttp |
| Maintenance | Actively maintained 17 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 704,379,780 / month, #45 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaIntended Audience :: DevelopersLicense :: OSI Approved :: BSD LicenseOperating System :: OS IndependentProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14 |
Evidence: s3fs-2026.7.0-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “python s3 file operations”
- s3fss3fs provides a Python filesystem interface to Amazon S3, allowing…
- fs-s3fsS3FS provides a PyFilesystem interface to Amazon S3, letting you…
- s5cmdProvides a Python wheel distribution that installs the s5cmd…
Give your agent the search over MCP, or paste the wish link into any chat.
Similar packages
Enables DVC to read from, write to, and manage data on Amazon S3 as a remote storage backend.
Provides a file-system-like interface to Google Cloud Storage, allowing you to read, write, and list objects in GCS buckets as if they were local directories.
Install it if you work with GCS and want to avoid learning GCS-specific APIs; the permissive license and stable dependency chain make it a safe choice.
Provides a Python wheel distribution that installs the s5cmd executable, a fast S3 and local filesystem tool with wildcard and tab-completion support for bulk file operations.
Transfers files between workstations and AWS Deadline Cloud using Amazon S3 as content-addressed storage, avoiding redundant uploads of identical files.
obstore provides a unified Python interface to Amazon S3, Google Cloud Storage, Azure Storage, and S3-compliant APIs, with both sync and async support, streaming uploads and downloads, and automatic multipart handling.
A Synapse media storage provider that integrates Amazon S3 (or S3-compatible services) as a backend for storing and retrieving media files.
Install it if you run Synapse and want S3-backed media storage; skip it if you use local disk storage or a different homeserver.