{"categories":[{"label":"Database","url":"https://skillfed.io/packages/category/database/3"}],"enrichment":{"capability":"OpenMetadata Ingestion is a framework for building connectors and ingesting metadata from various systems into OpenMetadata via its APIs, typically integrated into orchestration tools like Apache Airflow.","skillfed_tags":["metadata-ingestion","data-catalog","orchestration-framework"],"use_cases":["Automatically extract metadata from databases, data warehouses, and data lakes and sync it to OpenMetadata on a schedule","Build custom connectors for proprietary or internal systems to integrate their metadata into a centralized catalog","Ingest data lineage and schema information from multiple sources in a single orchestrated workflow","Populate OpenMetadata with metadata from cloud services (Azure, Google Cloud) using managed credential stores","Monitor and profile metadata ingestion workflows using memory profiling and multi-threaded execution for large-scale operations"],"what_it_does":"OpenMetadata Ingestion is a Python framework for extracting metadata from external systems and pushing it into OpenMetadata's central metadata repository. It provides a pluggable connector architecture and a TopologyRunner execution engine that orchestrates the ingestion workflow, supporting both single-threaded and multi-threaded execution modes. The framework is designed to integrate with orchestration platforms like Apache Airflow, allowing metadata extraction to be scheduled and monitored as part of a broader data pipeline.\n\nThe package bundles 43 runtime dependencies covering cloud credential management (Azure Key Vault, Google Cloud Secrets), database connectivity (PyMySQL, SQLAlchemy), data transformation (Jinja2, Mako), and distributed execution (Kubernetes). It requires Python >= 3.9 and installs as a pure-Python wheel with low friction. The framework is actively maintained, though its licensing under the Collate Community License restricts use for competing SaaS or managed services.","worth_installing":"Yes, if you are already using OpenMetadata and need to ingest metadata from external systems. The framework is actively maintained, has low install friction, and provides a structured approach to metadata extraction. However, be aware of the Collate Community License restrictions: you cannot use it to offer competing metadata management services. If you need to evaluate whether the supported connectors cover your systems, consult the documentation."},"id":"openmetadata-ingestion","links":{"html":"https://skillfed.io/packages/openmetadata-ingestion","md":"https://skillfed.io/packages/openmetadata-ingestion.md","pypi":"https://pypi.org/project/openmetadata-ingestion/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-12","license_spdx":null,"license_treatment":"unclear","name":"openmetadata-ingestion","python_support":"supports_current","summary":"Ingestion Framework for OpenMetadata"},"popularity":{"monthly_downloads":519315,"position":6218,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.13.3.2"}
