apache-airflow-providers-vespa

What it is and what it does

This is an Apache Airflow provider package that adds Vespa integration capabilities to Airflow workflows. It allows you to orchestrate tasks that interact with Vespa clusters—a search and machine learning engine—directly from Airflow DAGs. The package provides operators and hooks built on top of pyvespa, the official Python client for Vespa, enabling you to define, schedule, and monitor Vespa operations as part of larger data pipelines.

The package is production-ready (Development Status 5) and actively maintained by the Apache Airflow project. It supports Python 3.10 through 3.14 and requires Airflow >=2.11.0. Installation is straightforward via pip, with low friction since it's a pure-Python wheel with no compiled dependencies.

Use it for:

• Schedule regular data feeds to Vespa search clusters as part of an Airflow pipeline.
• Orchestrate machine learning model deployments and updates to Vespa clusters on a fixed schedule.
• Build multi-step workflows that query Vespa, process results, and feed refined data back.
• Monitor and manage Vespa cluster operations (indexing, redeployment) alongside other Airflow tasks.
• Integrate Vespa search operations into larger ETL or data processing DAGs.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Integrates Apache Airflow with Vespa, enabling workflow orchestration for search and machine learning operations on Vespa clusters.

Yes. This is an official Apache Airflow provider for Vespa integration, actively maintained with no known vulnerabilities. Install friction is low, the license is permissive, and it's production-ready. Install it if you run Airflow and need to orchestrate Vespa operations; otherwise, it has no value.

Install

apache-airflow-providers-vespa on PyPI

pip install apache-airflow-providers-vespa

uv add apache-airflow-providers-vespa

poetry add apache-airflow-providers-vespa

Installing apache-airflow-providers-vespa

Before you install

Low install friction with a pure-Python wheel. Actively maintained by Apache; last commit 2026-08-14. Requires Apache Airflow >=2.11.0 and pyvespa >=1.1.2.

License in practice

Licensed under Apache-2.0 (permissive), allowing commercial and private use with minimal restrictions.

Quickstart

pip install apache-airflow-providers-vespa

from airflow.providers.vespa.operators import VespaOperator
from airflow import DAG

with DAG('vespa_dag') as dag:
    task = VespaOperator(task_id='vespa_task')

Requires Apache Airflow >=2.11.0 and Python >=3.10; Vespa cluster must be accessible from Airflow environment.

Verify before relying

• What specific Vespa operations (feed, query, deploy) are supported by the available operators and hooks.
• Whether authentication mechanisms (API keys, certificates) are documented for Vespa cluster connections.
• Performance characteristics when handling large-scale data pipelines to Vespa.

Package facts

Evidence: apache_airflow_providers_vespa-0.1.1-py3-none-any.whl

Keywords: airflow-provider, vespa, airflow, integration

Tags

More Monitoring packages