apache-airflow-providers-git

What it is and what it does

This is an official Apache Airflow provider package that adds Git repository operations to Airflow DAGs. It wraps GitPython and exposes operators and hooks for cloning, pulling, and managing Git repositories as part of workflow orchestration. The package is built on top of apache-airflow and apache-airflow-providers-common-compat, following Airflow's provider architecture.

Typical use is to trigger Git operations (clone, fetch, checkout) within a DAG task, allowing pipelines to pull source code, configuration, or data from Git repositories as a workflow step. It's intended for teams using Airflow to orchestrate data and ML workflows that depend on versioned code or data stored in Git.

Use it for:

• Clone a Git repository containing data processing scripts at the start of a data pipeline DAG.
• Pull the latest version of a configuration repository before running downstream transformation tasks.
• Orchestrate multi-stage workflows where different tasks check out different branches or tags.
• Integrate Git-based feature branches into automated ML model training pipelines.
• Manage version-controlled SQL or dbt models as part of a scheduled data warehouse update.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Integrates Git version control operations into Apache Airflow workflows, enabling DAGs to clone, pull, and interact with Git repositories as part of data pipeline orchestration.

Yes, if you are already running Apache Airflow >=3.0.0 and need to incorporate Git operations into DAG workflows. The package is actively maintained, has no known vulnerabilities, carries a permissive license, and installs with low friction. It is a straightforward extension of Airflow's provider ecosystem for a common use case.

Install

apache-airflow-providers-git on PyPI

pip install apache-airflow-providers-git

uv add apache-airflow-providers-git

poetry add apache-airflow-providers-git

Installing apache-airflow-providers-git

Before you install

Low friction installation as a pure-Python wheel. Actively maintained with a recent release (6 days old) and backed by the Apache Airflow project's 46490-star repository. Requires Apache Airflow >=3.0.0 and GitPython >=3.1.44.

License in practice

Apache-2.0 permissive license allows commercial and private use with minimal restrictions; suitable for most organizational contexts.

Quickstart

pip install apache-airflow-providers-git

from airflow.providers.git.operators.git import GitCloneOperator
from airflow import DAG

with DAG('my_dag') as dag:
    clone_task = GitCloneOperator(
        task_id='clone_repo',
        repo_url='https://github.com/example/repo.git',
        branch='main'
    )

Requires Apache Airflow >=3.0.0 and Python >=3.10; GitPython >=3.1.44 must be available.

Verify before relying

• Specific Git operators and hooks available beyond basic clone/pull operations.
• Support for SSH keys, authentication methods, or credential management patterns.
• Handling of large repositories or shallow clones for performance optimization.

Package facts

Evidence: apache_airflow_providers_git-0.4.2-py3-none-any.whl

Keywords: airflow-provider, git, airflow, integration

Tags

More Monitoring packages