{"categories":[{"label":"Build Tools","url":"https://skillfed.io/packages/category/software-development-build-tools/2"}],"enrichment":{"capability":"A Python framework and CLI tool for building and deploying workflows to Databricks, enabling you to define multi-task data pipelines as Python code with task dependencies and scheduling.","skillfed_tags":["databricks-integration","workflow-orchestration","infrastructure-as-code"],"use_cases":["Define multi-task ETL pipelines as Python code with task dependencies, then deploy in one command.","Parameterize workflows using common_task_parameters to inject catalog, schema, and environment variables across tasks.","Orchestrate mixed workloads: Python tasks, notebook execution, Spark SQL, and bash commands in one definition.","Version control workflow definitions alongside code and deploy via CI/CD pipelines.","Schedule recurring workflows using cron expressions with automatic descriptor generation and timezone handling."],"what_it_does":"Brickflow lets you define workflows as Python code using decorators and task dependencies, then deploy them via CLI. Instead of manually configuring jobs in a UI, you write Python functions with @wf.task decorators, specify their dependencies, and the framework translates that into workflow definitions. It handles cluster configuration, notebook execution, Spark SQL, and bash commands as tasks within a single workflow.\n\nThe package integrates with click for CLI, Jinja2 for templating, Pydantic for validation, and scheduling libraries (croniter, pendulum, cron-descriptor) to support cron-based triggers and complex task orchestration. It's aimed at teams building data pipelines who want infrastructure-as-code for their workflows, with a focus on local development and CI/CD deployment patterns.","worth_installing":"Yes, if you are building data pipelines on Databricks and want to manage workflows as Python code. The package is actively maintained, has low install friction, uses permissive licensing, and integrates cleanly with standard Python tooling. It is most valuable for teams already using Python for data work and seeking a declarative, version-controllable alternative to UI-based job configuration."},"id":"brickflows","links":{"html":"https://skillfed.io/packages/brickflows","md":"https://skillfed.io/packages/brickflows.md","pypi":"https://pypi.org/project/brickflows/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-07","license_spdx":null,"license_treatment":"permissive","name":"brickflows","python_support":"capped_below_current","summary":"Deploy scalable workflows to databricks using python"},"popularity":{"monthly_downloads":813998,"position":4995,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"2.0.0"}