Packages
Integrates Weaviate vector database operations into Apache Airflow workflows, providing operators and hooks to orchestrate data ingestion, querying, and management tasks.
Install it if you are already running Airflow and need to orchestrate Weaviate tasks; skip it if you do not use Airflow or do not need vector database integration.
Integrates Apache Beam data processing pipelines into Apache Airflow workflows, enabling orchestration of batch and streaming jobs through Airflow's DAG framework.
Install only if you have both Airflow and Beam in your stack; it adds no value as a standalone library.
Extends Apache Airflow with an EdgeExecutor and edge worker framework for orchestrating tasks across remote sites via HTTPS, enabling work distribution through firewalls and network restrictions.
Install only if you have a concrete edge deployment scenario; it adds no value for single-site Airflow setups.
Sends Python application logs and performance metrics (execution time, CPU, memory) to Rapid7 Insight via an asynchronous logging handler.
However, the dormant maintenance status means you should verify compatibility with your current Rapid7 API version and Python environment before relying on it in…
Monitors, debugs, and profiles workloads running on cloud accelerators (TPUs and GPUs), with built-in support for uploading diagnostic data to Vertex AI Tensorboard.
However, verify the license treatment before use in commercial contexts, and confirm that google-cloud-aiplatform's dependencies fit your environment.
Integrates Apache Druid with Apache Airflow, providing operators and hooks to query and manage Druid data sources within Airflow workflows.
Install only if you have an existing Airflow deployment and a Druid cluster to connect to.
Sends custom events to Azure Application Insights using OpenTelemetry, extending the Azure Monitor OpenTelemetry Distro with event-specific instrumentation.
However, the dormant maintenance status (last commit December 2023, no releases since 0.1.0) means you should verify compatibility with your current OpenTelemetry…
CLI tool that detects Cloud TPU devices and reads runtime metrics from libtpu, including memory usage and duty cycle, in both static snapshot and live streaming modes.
Integrates Apache Airflow with Asana, enabling workflow automation to create, update, and manage Asana tasks and projects from Airflow DAGs.
Install only if you have Airflow >=2.11.0 already deployed and a use case that benefits from programmatic Asana interaction.
Judgeval is an SDK for tracing and evaluating LLM-powered agents in production, capturing function inputs/outputs and token usage via OpenTelemetry, then running prompt-based judges to score agent behaviors and surface regressions.
Install it if you need production tracing and behavior-based evaluation for agents.
Provides AWS CDK constructs to automatically instrument Lambda functions and ECS Fargate services with Datadog monitoring, configuring metrics, traces, and logs collection without manual layer management.
Install it if you are already using AWS CDK v2 and want Datadog observability; it saves configuration effort and enforces consistent instrumentation across your…
Integrates Django applications with Datadog logging by providing middleware for request tracking, error logging, and JSON-formatted log output compatible with Datadog's ingestion.
Install it if you need structured logging in Django with Datadog compatibility; skip it if you use a different observability platform or don't need JSON-formatted logs.
Adds observability instrumentation to gRPC Python applications, collecting telemetry data from gRPC Core and exporting it via OpenTelemetry.
Install only if your deployment is Linux-based; Windows and macOS users cannot use it.
Acceldata SDK provides Python instrumentation support for ADOC (Acceldata's architecture framework), enabling integration with Acceldata's data observability platform.
However, verify first that your environment has an Acceldata backend and that the SDK's API aligns with your instrumentation needs—the fact sheet does not detail the…
Provides programmatic access to Azure Resource Health data—availability status, events, and emerging issues—for resources in your Azure subscription.
Install it if you need programmatic access to Azure resource health, availability status, or event data; skip it if you only use the Azure Portal or CLI for health…
Adds async/await support to Prometheus metrics collection for asyncio and Twisted applications, wrapping the official prometheus-client library.
Integrates Apache Hadoop Distributed File System (HDFS) and WebHDFS with Apache Airflow, enabling workflows to read, write, and manage files on Hadoop clusters.
Integrates Apache Airflow with Telegram to send notifications and messages from Airflow workflows via the Telegram Bot API.
Integrates Presto query execution into Apache Airflow workflows, enabling scheduled and triggered SQL queries against Presto clusters with result handling via pandas DataFrames.
Install it if you are already running Airflow and need to orchestrate Presto workloads; it is production-ready and widely used.
Provides a Python client library for managing Azure Sentinel (Security Insight) resources—alert rules, incidents, data connectors, watchlists, and related entities—via the Azure REST API.
However, be aware that version 1.0.0 removed many operation groups and model fields; verify that the operations you need are still present before upgrading or…
Provides healthcheck and environment-dump endpoints for web applications to expose application status and dependency health to monitoring systems.
Automatically instruments AWS Bedrock API calls (invoke_model, converse, invoke_agent) made via boto3 and aioboto3 to emit OpenTelemetry traces for observability and debugging.
Adds OpenTelemetry observability instrumentation to the NVIDIA NeMo Agent Toolkit, enabling trace collection and export for agent applications.
Install only if your workflow involves the NeMo Agent Toolkit; it is not a standalone observability library.
Integrates Prometheus metrics collection and export into Dagster data pipelines, enabling monitoring and observability of pipeline runs and asset computations.
Install only if you have a Prometheus deployment in place or plan to set one up; otherwise, Dagster's built-in observability may suffice.
Provides Apache Airflow operators and hooks to integrate IBM Cloudant databases into data pipelines, enabling read and write operations within Airflow workflows.
Provides core telemetry abstractions (spans, events, attributes) and a recorder interface for collecting and exporting observability data from applications and long-running jobs.
However, the aging maintenance status (289 days since last release) suggests limited active development—verify whether it fits your stability and support expectations…
Adds persistent job scheduling to Django applications using APScheduler, storing scheduled tasks in the database and providing Django admin integration for job management and execution monitoring.
Exports OpenTelemetry tracing data to Zipkin using Protobuf serialization over HTTP, enabling distributed trace collection and analysis.
Integrates Vertica database connectivity into Apache Airflow, enabling DAG tasks to connect to, query, and manage Vertica instances.
Install it if you run Airflow and need to integrate Vertica databases into your orchestration workflows.
Integrates Apache Airflow with Facebook Ads, enabling scheduled workflows to interact with Facebook's advertising platform through the facebook-business SDK.
Jaeger-client instruments Python applications for distributed tracing and sends trace data to Jaeger, implementing the OpenTracing API for trace collection and reporting.
Install only if you are maintaining legacy code that cannot yet migrate and your Jaeger backend still accepts this client's spans; otherwise, use OpenTelemetry.
SAQ is an async job queue framework that runs background tasks using asyncio, backed by Redis or PostgreSQL, with optional cron scheduling and a web monitoring UI.
A terminal monitoring tool that connects to uWSGI's stats server and displays real-time worker metrics in a top-like interface.
However, dormant maintenance (last release 865 days ago) and high install friction mean verify compatibility with your Python version and uWSGI release before relying…
Glean SDK is Mozilla's telemetry collection library that lets applications gather, validate, and send structured usage data to Mozilla's data pipeline.
Provides Apache Airflow integration operators and hooks for orchestrating Informatica workflows as part of Airflow DAGs.
Integrates Apache Airflow with Segment for sending analytics events and data from Airflow workflows to Segment's CDP platform.
Install it if you run Airflow >=2.11.0 and need to integrate workflows with Segment; otherwise, it adds no value.
Installs a convenience bundle of OpenTelemetry Zipkin exporters (JSON and protobuf-HTTP serialization formats) for sending trace spans to Zipkin backends.
However, once you've settled on a serialization method, consider switching to the specific exporter package to reduce dependencies.
GeoIP2Fast performs fast geolocation lookups for IPv4 and IPv6 addresses, returning country codes, city names, ASN information, and CIDR blocks from a local binary data file.
Integrates Apache Cassandra with Apache Airflow, providing operators and hooks to query, insert, and manage data in Cassandra clusters from Airflow DAGs.
Install it if you run Airflow and need to orchestrate Cassandra workloads; it is the standard integration for that use case.
Formats Python stdlib logging output as logfmt structured logs without modifying existing log calls, enabling both human and machine-readable output.