{"categories":[{"label":"Database","url":"https://skillfed.io/packages/category/database/3"}],"enrichment":{"capability":"DiscoverX automates bulk administration tasks across Lakehouse assets by executing SQL templates or Python functions concurrently against multiple Delta tables matching selection patterns.","skillfed_tags":["databricks","lakehouse-admin","bulk-operations"],"use_cases":["Run OPTIMIZE and VACUUM across all tables in a schema or catalog to reclaim storage and improve query performance.","Deep clone entire schemas or catalogs for testing or disaster recovery without manual table-by-table operations.","Detect and report on tables with too many small files or ineffective ZORDER clustering across the entire lakehouse.","Scan all tables for PII (email, phone, IP) using semantic classification rules and extract or delete sensitive data for GDPR compliance.","Bulk update table ownership or apply tags across hundreds of assets matching a selection pattern."],"what_it_does":"DiscoverX is a Databricks Labs utility for automating administration across large numbers of Lakehouse assets. It lets you apply SQL templates or Python functions concurrently to multiple Delta tables selected by pattern matching, returning results as a unioned Spark DataFrame. Common use cases include bulk OPTIMIZE and VACUUM operations, deep cloning, tag management, owner changes, and semantic classification of columns for governance tasks like PII detection and GDPR compliance.\n\nThe package depends only on pyyaml and is designed to run in Databricks notebooks. It provides a fluent API (the `DX` class) for selecting tables, filtering by column presence, and executing templated operations with configurable concurrency. The fact sheet indicates the project is aging (469 days since last release) and carries no formal support SLA from Databricks\u2014it is provided as-is for exploration.","worth_installing":"Yes, if you are a Databricks user managing large Lakehouses and can tolerate the aging maintenance status and unclear license. The low install friction and no known vulnerabilities are positive signals. However, verify the license terms and test compatibility with your current Databricks and Python versions before production use, and understand that support is community-driven, not SLA-backed."},"id":"dbl-discoverx","links":{"html":"https://skillfed.io/packages/dbl-discoverx","md":"https://skillfed.io/packages/dbl-discoverx.md","pypi":"https://pypi.org/project/dbl-discoverx/"},"maintenance":{"status":"aging"},"meta":{"latest_release":"2025-05-02","license_spdx":null,"license_treatment":"unclear","name":"dbl-discoverx","python_support":"unspecified","summary":"DiscoverX - Map and Search your Lakehouse"},"popularity":{"monthly_downloads":541881,"position":6092,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.0.9"}