{"categories":[{"label":"Application Frameworks","url":"https://skillfed.io/packages/category/software-development-libraries-application-frameworks/5"}],"enrichment":{"capability":"Apache Hamilton is a Python library for defining and executing directed acyclic graphs (DAGs) of data transformations using regular Python functions, with built-in support for portability across execution contexts and features like data validation and experiment tracking.","skillfed_tags":["dag-orchestration","data-pipeline","etl"],"use_cases":["Build ETL pipelines where transformation logic is defined as modular Python functions and executed portably across local, notebook, and production environments.","Create ML workflows with automatic data lineage tracking, schema validation, and experiment logging via the Hamilton UI.","Develop RAG and LLM application pipelines with data validation and observability without switching frameworks between development and deployment.","Construct BI dashboard data pipelines that can be debugged locally and reused across Airflow, FastAPI, or other orchestration contexts.","Organize large data transformation codebases using function modifiers and multi-module assembly to keep DAG definitions maintainable."],"what_it_does":"Apache Hamilton is a lightweight Python library for building data transformation pipelines as directed acyclic graphs (DAGs). Instead of using a separate DSL or configuration format, you write regular Python functions whose parameters declare dependencies, and Hamilton automatically constructs the DAG from that definition. This approach keeps your code readable, testable, and self-documenting while remaining portable\u2014the same DAG runs in a Jupyter notebook, a local script, an Airflow pipeline, or a FastAPI server without modification.\n\nThe library emphasizes modularity and collaboration by separating DAG definition from execution, allowing data scientists to focus on transformation logic while engineers manage production deployment. It includes built-in features for data validation, experiment tracking, remote execution, and visualization through the optional Apache Hamilton UI. The project is actively maintained and marked Production/Stable, though it remains under Apache Incubation pending full ASF endorsement.","worth_installing":"Yes, with conditions. Install if you need a portable, function-based DAG framework for data pipelines and want to avoid boilerplate orchestration code. The low install friction, active maintenance, and Production/Stable classifier make it production-ready. However, verify that Apache Incubation status poses no concern for your organization, and confirm integration maturity with your specific orchestrator if you plan to move beyond local execution."},"id":"apache-hamilton","links":{"html":"https://skillfed.io/packages/apache-hamilton","md":"https://skillfed.io/packages/apache-hamilton.md","pypi":"https://pypi.org/project/apache-hamilton/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-04-25","license_spdx":"Apache-2.0","license_treatment":"permissive","name":"apache-hamilton","python_support":"supports_current","summary":"Apache Hamilton (incubating) is a lightweight Python library for directed acyclic graphs (DAGs) of transformations. Your DAG is **portable**; it runs anywhere Python runs, whether it's a script, notebook, Airflow pipeline, FastAPI server, etc. Your DAG is **expressive**; Apache Hamilton has extensive features to define and modify the execution of a DAG (e.g., data validation, experiment tracking, remote execution)."},"popularity":{"monthly_downloads":96598,"position":13205,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.90.0"}