scmrepo
scmrepo
Decision gist · record as of 2026-08-14
Yes, if you need to read files from Git revisions without checking them out or if you're building tools that abstract over multiple Git backends. The low install friction, active maintenance, permissive license, and zero known vulnerabilities make it a safe choice. Not necessary if you only work with checked-out repositories or have no need for Git-backed filesystem semantics.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Low install friction; pure Python wheel with no compiled dependencies.
- Actively maintained with a recent commit on 2026-08-10 and support across Python 3.9 through 3.14.
License · maintenance · safety
Apache-2.0 (permissive) — Apache-2.0 permissive license allows use in commercial and proprietary projects with minimal restrictions; you must include a copy of the license and note any modifications.
last release 2026-03-31 (136 days) · last repo commit 2026-08-10 · 26 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 2,048,480 downloads/mo, #3,341 on PyPI
Alternatives
Verify before relying
pip install scmrepo
from scmrepo.fs import GitFileSystem
fs = GitFileSystem("path/to/my/repo", rev="mybranch")
for root, dnames, fnames in fs.walk("path/in/repo"):
for fname in fnames:
print(fs.path.join(root, fname))- Whether all three Git backends (pygit2, dulwich, gitpython) are equally stable or if one is recommended as primary.
- Performance characteristics when working with large repositories or deeply nested directory trees.
- Whether async operations via aiohttp-retry are automatic or require explicit opt-in.
What it is and what it does
scmrepo is a wrapper around Git that exposes repositories as an fsspec filesystem, letting you treat Git revisions like mounted file systems. Instead of checking out a branch or commit to read its files, you instantiate a GitFileSystem pointing to a repo and revision, then use standard filesystem operations (walk, open, listdir) to access files directly from Git's object store. It abstracts over three different Git backends—pygit2, dulwich, and gitpython—so you can choose which one fits your environment.
The package is designed for use in data pipelines and version-control-aware tools (notably DVC) where you need to read versioned data without the I/O cost of a full checkout. Its ten runtime dependencies include fsspec for the filesystem abstraction, tqdm for progress reporting, and the three Git backends plus async utilities (aiohttp-retry, asyncssh) for flexible I/O patterns.
Use it for
- Read data files from a specific Git commit or branch without checking out the working tree.
- Iterate over directory structures in versioned repositories as part of a data pipeline.
- Abstract Git access in tools that need to work with multiple Git implementations transparently.
- Access historical file versions programmatically for auditing or reproducibility.
- Build version-aware file systems for machine-learning workflows that track data lineage.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you need to read files from Git revisions without checking them out or if you're building tools that abstract over multiple Git backends.
The low install friction, active maintenance, permissive license, and zero known vulnerabilities make it a safe choice. Not necessary if you only work with checked-out repositories or have no need for Git-backed filesystem semantics.
Install
scmrepo on PyPI
Before you install
Low install friction; pure Python wheel with no compiled dependencies. Actively maintained with a recent commit on 2026-08-10 and support across Python 3.9 through 3.14.
License in practice
Apache-2.0 permissive license allows use in commercial and proprietary projects with minimal restrictions; you must include a copy of the license and note any modifications.
Quickstart
pip install scmrepo
from scmrepo.fs import GitFileSystem
fs = GitFileSystem("path/to/my/repo", rev="mybranch")
for root, dnames, fnames in fs.walk("path/in/repo"):
for fname in fnames:
print(fs.path.join(root, fname))Verify before relying
- Whether all three Git backends (pygit2, dulwich, gitpython) are equally stable or if one is recommended as primary.
- Performance characteristics when working with large repositories or deeply nested directory trees.
- Whether async operations via aiohttp-retry are automatic or require explicit opt-in.
Package facts
| License | Apache-2.0 permissive |
| Python support | Supports the current Python release >=3.9 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 10 packagesgitpythondulwichpygit2pygtriefsspecpathspecasyncsshfuncyaiohttp-retrytqdm |
| Maintenance | Actively maintained 136 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 2,048,480 / month, #3,341 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaProgramming Language :: Python :: 3Programming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Programming Language :: Python :: 3.9 |
Evidence: scmrepo-3.6.2-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “git filesystem fsspec”
- scmreposcmrepo provides an fsspec-based filesystem interface to Git…
- morefsmorefs provides fsspec-based filesystem implementations including…
- gdrive-fsspecProvides a fsspec-compatible filesystem interface for Google Drive,…
Give your agent the search over MCP, or paste the wish link into any chat.
More Software Development packages
Provides backported and experimental type hints for Python 3.9+, allowing use of newer typing features on older Python versions and enabling early experimentation with type system PEPs before they enter the standard library.
NumPy provides an N-dimensional array object and a comprehensive suite of mathematical, linear algebra, Fourier transform, and random number functions for scientific computing in Python.
FastAPI is a Python web framework for building REST APIs using type hints, with automatic request validation, serialization, and interactive API documentation.
Provides a way to document function parameters, class attributes, return types, and variables inline using Python's `Annotated` type hint syntax instead of traditional docstrings.
Typer builds command-line applications from Python functions using type hints, automatically generating help text, argument parsing, and shell completion.
Install it if you are building CLIs in Python.
Distlib provides low-level packaging utilities for building, distributing, and managing Python software—including metadata handling, version specifiers, wheel support, script installation, and dependency resolution.
See also dulwich · gdrive-fsspec · dvc-objects · sshfs · morefs · fsspec · pygit2 · gitdb2 · gitdb · GitPython