gcsfs
Convenient Filesystem interface over GCS
Decision gist · record as of 2026-08-14
Yes. gcsfs is actively maintained, has no known vulnerabilities, low install friction, and solves a real problem—abstracting GCS behind a familiar file interface. It's widely used and supports current Python versions. Install it if you work with GCS and want to avoid learning GCS-specific APIs; the permissive license and stable dependency chain make it a safe choice.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.10 or later and valid Google Cloud credentials (local gcloud, service account, or environment-based).
- Low friction install with a pure-Python wheel.
- Actively maintained with a release from 2026-08-13, last commit 2026-08-14, and no known vulnerabilities.
License · maintenance · safety
BSD-3-Clause (permissive) — BSD-3-Clause is permissive; you can use, modify, and distribute this package freely in commercial and private projects with minimal restrictions.
last release 2026-08-13 (1 days) · last repo commit 2026-08-14 · 395 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 149,484,372 downloads/mo, #268 on PyPI
Alternatives
Verify before relying
pip install gcsfs
import gcsfs
fs = gcsfs.GCSFileSystem(project='my-google-project')
files = fs.ls('my-bucket')
with fs.open('my-bucket/data.txt', 'rb') as f:
content = f.read()- Whether the asynchronous API (aiohttp-backed) is production-ready for high-concurrency workloads.
- Performance characteristics of Hierarchical Namespace (HNS) and Rapid Buckets features in real-world scenarios.
- Support scope for the ExtendedFileSystem implementation across different GCS bucket types.
What it is and what it does
gcsfs wraps Google Cloud Storage behind a familiar Python file-system abstraction, built on fsspec. Instead of learning GCS-specific APIs, you use standard file operations (open, read, write, ls) on bucket paths. It handles authentication through multiple modes—default gcloud credentials, service accounts, cloud metadata service, or anonymous access—and integrates with the broader Python data ecosystem.
The library supports both standard GCS buckets and specialized storage types: Hierarchical Namespace buckets offer atomic directory renames and higher throughput for AI/ML workloads, while Rapid Buckets provide zonal co-location and true append operations for low-latency streaming. It includes an asynchronous API via aiohttp for high-concurrency applications, though the synchronous interface is the primary entry point.
Use it for
- Load training data or model checkpoints from GCS buckets in data science pipelines without custom cloud API code.
- Stream large files from GCS in chunks using standard Python file operations for memory-efficient processing.
- Migrate local file-based workflows to cloud storage by swapping local paths with gs:// bucket URIs.
- Build high-throughput data ingestion on Rapid Buckets with true append semantics for real-time logging.
- Perform atomic directory operations on Hierarchical Namespace buckets for managing millions of small files.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes.
gcsfs is actively maintained, has no known vulnerabilities, low install friction, and solves a real problem—abstracting GCS behind a familiar file interface. It's widely used and supports current Python versions. Install it if you work with GCS and want to avoid learning GCS-specific APIs; the permissive license and stable dependency chain make it a safe choice.
Install
gcsfs on PyPI
Before you install
Low friction install with a pure-Python wheel. Actively maintained with a release from 2026-08-13, last commit 2026-08-14, and no known vulnerabilities. Depends on established libraries (fsspec, google-auth, aiohttp, requests) that are widely used.
Requires Python 3.10 or later and valid Google Cloud credentials (local gcloud, service account, or environment-based).
License in practice
BSD-3-Clause is permissive; you can use, modify, and distribute this package freely in commercial and private projects with minimal restrictions.
Quickstart
pip install gcsfs
import gcsfs
fs = gcsfs.GCSFileSystem(project='my-google-project')
files = fs.ls('my-bucket')
with fs.open('my-bucket/data.txt', 'rb') as f:
content = f.read()
Verify before relying
- Whether the asynchronous API (aiohttp-backed) is production-ready for high-concurrency workloads.
- Performance characteristics of Hierarchical Namespace (HNS) and Rapid Buckets features in real-world scenarios.
- Support scope for the ExtendedFileSystem implementation across different GCS bucket types.
Package facts
| License | BSD-3-Clause permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 8 packagesaiohttpdecoratorfsspecgoogle-auth-oauthlibgoogle-authgoogle-cloud-storage-controlgoogle-cloud-storagerequests |
| Maintenance | Actively maintained 1 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 149,484,372 / month, #268 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaIntended Audience :: DevelopersLicense :: OSI Approved :: BSD LicenseOperating System :: OS IndependentProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14 |
Evidence: gcsfs-2026.8.0-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “google cloud storage python interface”
- gcsfsProvides a file-system-like interface to Google Cloud Storage,…
- gsutilgsutil is a command-line tool for managing Google Cloud Storage…
- obstoreobstore provides a unified Python interface to Amazon S3, Google…
Give your agent the search over MCP, or paste the wish link into any chat.
Similar packages
gsutil is a command-line tool for managing Google Cloud Storage buckets and objects, supporting operations like creation, deletion, upload, download, listing, and ACL editing.
s3fs provides a Python filesystem interface to Amazon S3, allowing you to read, write, and navigate S3 buckets using standard file operations.
Install it if you need filesystem-like access to S3 from Python; the standard file interface will be more intuitive than raw boto3 calls for most use cases.
Provides a local emulator for Google Cloud Storage that intercepts API calls during development and testing, allowing you to work offline without connecting to production GCS.
However, verify that the limited API subset it supports covers your use case—this is explicitly an Alpha tool, not a complete GCS replacement.
Provides a fsspec-compatible filesystem interface for Google Drive, allowing you to read, write, and browse files on Google Drive using standard filesystem operations.
Not recommended for production systems requiring guaranteed stability—wait for a stable release or use the official Google Drive API directly if production…
fsspec provides a unified filesystem interface specification and implementations for accessing local, remote, and cloud storage backends through a common Python API.
Provides a fsspec-compatible filesystem interface to Oracle Cloud Infrastructure Object Storage, enabling file-like operations on OCI buckets through a standard API.
See also gcloud-aio-storage · blobfile · snakemake-storage-plugin-gcs · kbcstorage