apache-airflow-providers-edge3

What it is and what it does

This is an Apache Airflow provider package that adds edge computing capabilities to Airflow, allowing you to orchestrate tasks on remote worker nodes deployed at distant sites. The package provides an EdgeExecutor (a custom Airflow executor) and a lightweight edge worker process designed to run in environments with strict network restrictions—such as behind firewalls or in isolated data centers—where the only requirement is outbound HTTPS connectivity back to your central Airflow instance.

The edge worker model solves a specific deployment problem: when you need to execute Airflow tasks on remote sites but cannot run a full Airflow installation or maintain direct inbound connections, you deploy the edge worker instead. The central Airflow site uses the EdgeExecutor to schedule and manage work on these remote workers via REST API endpoints. The EdgeExecutor can coexist with other executors in the same Airflow installation, making it suitable for hybrid deployments where some tasks run locally and others run on edge sites.

Use it for:

• Deploy task execution to remote manufacturing plants or field sites where only outbound HTTPS is permitted.
• Orchestrate data collection or processing at geographically distributed locations from a central Airflow instance.
• Run Airflow tasks in network-restricted environments (behind corporate firewalls) without exposing inbound ports.
• Manage hybrid workloads where some tasks execute locally and others run on edge workers across multiple sites.
• Reduce operational overhead at remote sites by using a lightweight edge worker instead of a full Airflow installation.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Extends Apache Airflow with an EdgeExecutor and edge worker framework for orchestrating tasks across remote sites via HTTPS, enabling work distribution through firewalls and network restrictions.

Yes, if you run Apache Airflow and need to orchestrate tasks on remote sites with network restrictions. The package is actively maintained, has no known vulnerabilities, and is backed by the Apache Airflow project. Install only if you have a concrete edge deployment scenario; it adds no value for single-site Airflow setups.

Install

apache-airflow-providers-edge3 on PyPI

pip install apache-airflow-providers-edge3

uv add apache-airflow-providers-edge3

poetry add apache-airflow-providers-edge3

Installing apache-airflow-providers-edge3

Before you install

Low install friction as a pure-Python wheel. Actively maintained with a release 6 days old and backed by the Apache Airflow project (46490 stars). Requires Apache Airflow >=3.0.0 and several async/HTTP dependencies already common in Airflow ecosystems.

License in practice

Apache-2.0 permissive license allows commercial and private use without restriction, typical for Apache Foundation projects.

Quickstart

pip install apache-airflow-providers-edge3

from airflow.providers.edge3.executors import EdgeExecutor
from airflow import DAG

# Configure EdgeExecutor in your Airflow installation
# and deploy edge workers on remote sites

Requires Apache Airflow >=3.0.0 (not 3.1.0) already installed; edge workers must be deployed separately on remote sites and able to reach the central Airflow instance via HTTPS.

Verify before relying

• Specific REST API endpoints and their usage patterns for task distribution and worker management.
• How EdgeExecutor coexists operationally with CeleryExecutor or KubernetesExecutor in practice.
• Network latency and throughput characteristics for HTTPS-based task orchestration across sites.

Package facts

Evidence: apache_airflow_providers_edge3-4.3.0-py3-none-any.whl

Keywords: airflow, airflow-provider, edge3, integration

Tags

More Monitoring packages

Further reading