{"categories":[{"label":"Distributed Computing","url":"https://skillfed.io/packages/category/system-distributed-computing"}],"enrichment":{"capability":"Databricks Connect is a client library that lets you write Spark code locally in your IDE or notebook and execute it remotely on a Databricks cluster instead of running it locally.","skillfed_tags":["spark-client","databricks-integration","remote-execution"],"use_cases":["Develop and test Spark jobs in your IDE without installing a local Spark cluster.","Run interactive Spark queries from a notebook server connected to a shared Databricks workspace.","Integrate Spark computation into a Python application running on a lightweight client machine.","Prototype data pipelines locally before deploying them to production Databricks clusters.","Use Databricks-managed infrastructure for compute-heavy workloads while keeping your development loop fast."],"what_it_does":"Databricks Connect bridges your local development environment\u2014IDE, notebook server, or custom application\u2014to a remote Databricks cluster. Instead of installing and running Spark locally, you write code using familiar Spark APIs and execute it on a managed Databricks cluster, letting the cluster handle computation while your local machine remains lightweight.\n\nThe package depends on py4j for JVM interop, grpcio for remote communication, and standard data libraries like pandas, pyarrow, and numpy. It's actively maintained and has low install friction as a pure-Python wheel, but it locks you to Python 3.12 and requires a Databricks workspace with valid credentials to function.","worth_installing":"Yes, if you have a Databricks workspace and need to run Spark code from a local IDE or notebook. The low install friction, active maintenance, and zero known vulnerabilities make it safe to adopt. The Python 3.12 requirement and proprietary license are the main constraints\u2014verify the license terms for your use case and ensure your environment supports Python 3.12."},"id":"databricks-connect","links":{"html":"https://skillfed.io/packages/databricks-connect","md":"https://skillfed.io/packages/databricks-connect.md","pypi":"https://pypi.org/project/databricks-connect/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-31","license_spdx":null,"license_treatment":"unclear","name":"databricks-connect","python_support":"capped_below_current","summary":"Databricks Connect Client"},"popularity":{"monthly_downloads":12249777,"position":1332,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"19.0.0"}