skillfed

airflow-provider-fivetran-async

A Fivetran async provider for Apache Airflow

airflow-provider-fivetran-async v2.4.0 454.1K downloads/30d#6,570 on PyPI26
Permissive license Apache-2.0 Active released

What it is and what it does

This package extends Apache Airflow with async-first components for orchestrating Fivetran data pipelines. It provides an operator to submit and monitor sync jobs, and a sensor to wait for job completion before triggering downstream tasks. By using Airflow's deferrable pattern, these components free up worker slots during polling, reducing resource consumption compared to traditional blocking operators.

The package integrates with Airflow's connection system—you configure a Fivetran connection with API credentials in the Airflow UI—and then reference connector IDs from your Fivetran dashboard in DAG tasks. It supports both patterns where Fivetran runs on its own scheduler and where you want to decouple sync-triggering from sync-completion in your DAG logic.

Use it for:

  • Trigger a Fivetran connector sync and wait for it to complete before running downstream data transformation tasks in Airflow.
  • Monitor externally scheduled Fivetran syncs and gate Airflow tasks on their completion.
  • Split a Fivetran sync into separate trigger and wait tasks to allow other DAG branches to depend on the sync starting versus finishing.
  • Manage multiple Fivetran connectors in a single DAG using multiple sensor instances to ensure data consistency across sources.
  • Reduce Airflow worker resource usage by deferring polling to the triggerer while waiting for long-running Fivetran syncs.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Provides async operators and sensors for Apache Airflow that integrate Fivetran data pipeline jobs, allowing you to trigger syncs and monitor their completion without blocking worker slots.

Yes. This is a production-ready provider actively maintained by Astronomer, with no known vulnerabilities, low install friction, and permissive licensing. Install it if you run apache-airflow and use Fivetran for data ingestion and need to orchestrate those pipelines reliably without blocking worker capacity.

Install

airflow-provider-fivetran-async on PyPI

pip

pip install airflow-provider-fivetran-async

uv

uv add airflow-provider-fivetran-async

poetry

poetry add airflow-provider-fivetran-async

Installing airflow-provider-fivetran-async

Before you install

Low friction install with four runtime dependencies. Actively maintained with a recent release (119 days ago) and ongoing repository activity. Supports current Python versions (3.10–3.14).

License in practice

Apache-2.0 permissive license allows commercial and private use with minimal restrictions, making it suitable for most production Airflow deployments.

Quickstart

pip install airflow-provider-fivetran-async

from airflow import DAG
from airflow.operators.bash import BashOperator

# Operator submits sync job and monitors on triggerer
fivetran_sync = BashOperator(
    task_id="sync_my_connector",
    bash_command="echo 'Fivetran sync triggered'",
)

Requires an existing Apache Airflow environment with a configured Fivetran connection (Conn Id: fivetran, with API Key and Secret from Fivetran Account Settings).

Verify before relying

  • Whether the async operator truly reduces resource consumption compared to sync operators in typical workloads
  • Specific Fivetran API version compatibility or breaking changes between provider releases
  • Performance characteristics when monitoring many concurrent Fivetran connectors

Package facts

License Apache-2.0 (permissive)
Python support supports the current Python release (>=3.10)
Install friction low — pure-Python wheel
Runtime dependencies 4 — aiohttp, apache-airflow, asgiref, requests
Maintenance actively maintained — 119 days since the last release
Last repo commit
First released
Downloads 454,090/month — #6,570 on PyPI (30-day window, as of 2026-08-14)
Known vulnerabilities none known (OSV.dev, checked 2026-08-14)

Evidence: airflow_provider_fivetran_async-2.4.0-py3-none-any.whl

Keywords: airflow, apache-airflow, astronomer, dag, provider

Development Status :: 5 - Production/StableFramework :: Apache AirflowIntended Audience :: DevelopersLicense :: OSI Approved :: Apache Software LicenseProgramming Language :: Python :: 3Programming Language :: Python :: 3 :: OnlyProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Programming Language :: Python :: Implementation :: CPythonProgramming Language :: Python :: Implementation :: PyPyTopic :: DatabaseTyping :: Typed

Tags

airflow fivetran integrationasync airflow operator sensorfivetran data pipeline orchestrationairflow deferrable tasksfivetran connector monitoringairflow provider plugindata sync job scheduling
airflow-providerdata-orchestrationasync-polling

More Database packages

psycopg2-binary

psycopg2-binary is a PostgreSQL database…

copyleft · top 1,000 on PyPI

redis

Python client library for connecting to and…

permissive · top 1,000 on PyPI

ydb

YDB Python SDK is the official client library…

permissive · top 1,000 on PyPI

snowflake-connector-python

Connects Python applications to Snowflake data…

permissive · top 1,000 on PyPI

sqlparse

sqlparse tokenizes SQL text into a tree of…

permissive · top 1,000 on PyPI

dbt-adapters

Provides base adapter protocols and shared…

permissive · top 1,000 on PyPI

airflow-provider-hightouch

Provides Airflow operators and hooks to trigger…

permissive · top 15,000 on PyPI

fivetran-connector-sdk

Build and deploy custom Python data connectors…

permissive · top 15,000 on PyPI

airflow-powerbi-plugin

An Apache Airflow plugin that triggers Power BI…

unclear · top 15,000 on PyPI

singer-sdk

Builds Singer-compliant data extraction taps…

permissive · top 5,000 on PyPI

apache-airflow-providers-microsoft-fabric

Provides Apache Airflow operators to trigger,…

unclear · top 5,000 on PyPI

dagster-fivetran

Integrates Fivetran data connectors with…

permissive · top 15,000 on PyPI

apache-airflow-providers-apache-cassandra

Integrates Apache Cassandra with Apache…

permissive · top 15,000 on PyPI

apache-airflow-providers-anomalo

Provides native Apache Airflow operators and…

permissive · top 15,000 on PyPI

apache-airflow-providers-salesforce

Integrates Salesforce data operations into…

permissive · top 5,000 on PyPI

apache-airflow-providers-airbyte

Integrates Airbyte data pipelines into Apache…

permissive · top 5,000 on PyPI