skillfed

ossdata

Scalable SWE datasets

ossdata v0.3.7 234.4K downloads/30d#9,023 on PyPI
Permissive license MIT Active released

What it is and what it does

OSSData is a Python package that wraps the Hugging Face datasets library to provide access to software engineering datasets, with backend support for Alibaba OSS cloud storage. It sits between your code and cloud-hosted SWE data, handling the mechanics of fetching and caching datasets locally.

The package depends on datasets for core dataset handling, tqdm for progress reporting, and alibabacloud-oss-v2 for cloud storage integration. It targets Python 3.8 and later and is actively maintained. The minimal description suggests it's designed for researchers and engineers who need standardized, reproducible access to SWE-focused datasets without managing storage infrastructure directly.

Use it for:

  • Fetch and cache software engineering datasets for machine learning model training.
  • Access cloud-hosted SWE data without managing Alibaba OSS credentials directly.
  • Build reproducible research pipelines that depend on versioned, standardized datasets.
  • Integrate SWE datasets into data processing workflows using the Hugging Face ecosystem.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Provides scalable datasets for software engineering research and development, integrating with cloud storage via Alibaba OSS and the Hugging Face datasets library.

Yes, if you need scalable SWE datasets and are comfortable with the Hugging Face datasets ecosystem. Low install friction, permissive MIT license, active maintenance, and no known vulnerabilities make it a safe choice. The main uncertainty is whether the available datasets match your specific research or development needs—verify dataset availability before committing.

Install

ossdata on PyPI

pip

pip install ossdata

uv

uv add ossdata

poetry

poetry add ossdata

Installing ossdata

Before you install

Low friction install with three straightforward dependencies. Active maintenance as of 2026-04-20, released within the last 116 days.

License in practice

MIT license permits commercial and private use with minimal restrictions; suitable for most projects.

Quickstart

pip install ossdata

from ossdata import load_dataset
dataset = load_dataset('dataset_name')

Requires Python 3.8 or later; Alibaba OSS credentials may be needed depending on dataset source.

Verify before relying

  • What specific SWE datasets are available and how they are organized.
  • Whether Alibaba OSS credentials are required for all datasets or only some.
  • Performance characteristics and scalability limits for large datasets.
  • Documentation and examples beyond the package summary.

Package facts

License MIT (permissive)
Python support supports the current Python release (>=3.8)
Install friction low — pure-Python wheel
Runtime dependencies 3 — datasets, tqdm, alibabacloud-oss-v2
Maintenance actively maintained — 116 days since the last release
First released
Downloads 234,389/month — #9,023 on PyPI (30-day window, as of 2026-08-14)
Known vulnerabilities none known (OSV.dev, checked 2026-08-14)

Evidence: ossdata-0.3.7-py3-none-any.whl

License :: OSI Approved :: MIT LicenseOperating System :: OS IndependentProgramming Language :: Python :: 3

Tags

software engineering datasetsscalable swe datacloud-backed datasetshugging face datasets integrationoss data loadingmachine learning dataset tools
datasetsmachine-learningsoftware-engineering

More Artificial Intelligence packages