apache-airflow-providers-singularity

What it is and what it does

This is an Apache Airflow provider package that adds Singularity container support to Airflow workflows. It wraps the spython library to allow Airflow tasks to execute inside Singularity containers, enabling reproducible, isolated task execution within your Airflow DAGs. The package is part of the official Airflow ecosystem and integrates seamlessly with Airflow's task scheduling and orchestration.

You install it on top of an existing Airflow installation (>=2.11.0) to gain access to Singularity operators and hooks. It supports Python 3.10 through 3.14 and depends on spython (>=0.0.56) to communicate with the Singularity runtime. The package is actively maintained and carries no known security vulnerabilities.

Use it for:

• Run containerized scientific computing tasks in Airflow pipelines using Singularity images.
• Execute isolated workloads on HPC clusters where Singularity is the standard container runtime.
• Reproduce complex computational environments across different Airflow worker nodes via container images.
• Integrate legacy or specialized applications packaged as Singularity containers into Airflow workflows.
• Enforce resource isolation and dependency management for multi-tenant Airflow task execution.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Integrates Singularity container runtime with Apache Airflow, enabling Airflow workflows to execute tasks inside Singularity containers via the spython library.

Yes, if you run Airflow and need to execute tasks in Singularity containers. The package is actively maintained, carries no security vulnerabilities, has low install friction, and is part of the official Airflow provider ecosystem. Install only if Singularity (or Apptainer) is available on your worker nodes; otherwise it will not function.

Install

apache-airflow-providers-singularity on PyPI

pip install apache-airflow-providers-singularity

uv add apache-airflow-providers-singularity

poetry add apache-airflow-providers-singularity

Installing apache-airflow-providers-singularity

Before you install

Low install friction; pure Python wheel. Requires apache-airflow >=2.11.0 and spython >=0.0.56. Actively maintained with recent release (68 days old), part of the Apache Airflow ecosystem with strong upstream support.

License in practice

Apache-2.0 permissive license; you can use, modify, and distribute this package freely in commercial and private projects, with minimal restrictions.

Quickstart

pip install apache-airflow-providers-singularity

from airflow.providers.singularity.operators.singularity import SingularityOperator
from airflow import DAG

with DAG('example') as dag:
    task = SingularityOperator(
        task_id='run_container',
        image='docker://ubuntu:latest',
        command='echo hello'
    )

Requires Singularity runtime installed on the Airflow worker nodes; Python >=3.10; apache-airflow >=2.11.0.

Verify before relying

• Whether Singularity must be installed on all worker nodes or only on specific execution nodes.
• Whether the package supports Apptainer (the maintained fork of Singularity) or only the original Singularity runtime.
• Specific performance characteristics or limitations when running large numbers of containerized tasks.

Package facts

Evidence: apache_airflow_providers_singularity-3.9.4-py3-none-any.whl

Keywords: airflow-provider, singularity, airflow, integration

Tags

More Monitoring packages