--- id: azure-synapse-spark version: "0.7.0" license: MIT License license_treatment: permissive maintenance: active --- # azure-synapse-spark — Microsoft Azure Synapse Spark Client Library for Python License: permissive · Maintenance: active · Downloads: 10.3M/mo ## What it is and what it does Azure Synapse Spark is a client library for the Microsoft Azure SDK that enables Python developers to interact with Apache Spark clusters provisioned in Azure Synapse Analytics. It wraps the Livy API, allowing you to submit Spark jobs, monitor their execution, and retrieve results programmatically. The library depends on msrest, azure-common, azure-core, and azure-synapse-nspkg to handle REST communication, authentication, and Azure SDK conventions. The package is classified as Beta and has been tested against Python 2.7 through 3.9, though Python 2.7 support ended in January 2022. It is maintained as part of the broader Azure SDK for Python but has not received updates since 2021-10-05, suggesting it may be stable or in maintenance mode rather than under active feature development. Use it for: - Automate Spark job submission and monitoring in Azure Synapse from Python applications or CI/CD pipelines. - Build data engineering workflows that programmatically trigger and track Spark computations on cloud infrastructure. - Integrate Spark cluster management into Python-based data platforms or orchestration tools. - Query Spark job status and retrieve execution logs from remote Synapse workspaces via API. ## Worth the install? AI-flagged interpretation of the facts above — verify before relying. Client library for interacting with Apache Spark clusters in Azure Synapse Analytics, providing programmatic access to Spark job submission and monitoring. Yes, if you are building Python applications that need to interact with Azure Synapse Spark clusters. The package has low install friction, permissive licensing, and active repository maintenance. However, verify that its API surface and feature set meet your needs before committing to it for new projects, given the gap since the last release. ## Install pip install azure-synapse-spark uv add azure-synapse-spark poetry add azure-synapse-spark ## Installing azure-synapse-spark Before you install: Low install friction with a pure-Python wheel distribution. Maintenance is active with recent commits, though the package itself has not been updated since October 2021, suggesting it may be in maintenance mode rather than active development. License in practice: MIT License permits free use, modification, and distribution with minimal restrictions, making it suitable for both open-source and commercial projects. Quickstart: pip install azure-synapse-spark from azure.synapse.spark import SparkClient from azure.identity import DefaultAzureCredential credential = DefaultAzureCredential() client = SparkClient(credential=credential, endpoint="https://.dev.azuresynapse.net") Requires Azure credentials and an active Azure Synapse workspace endpoint; authentication setup depends on your Azure environment. Verify before relying: - Whether Python 2.7 support has actually been dropped post-2022 despite classifiers still listing it. - Current compatibility with Python 3.10+ beyond what classifiers declare. - Whether the gap since last release indicates the package is feature-complete or abandoned. ## Package facts - License: MIT License (permissive) - Python support: unspecified - Install friction: low - Maintenance: active - Downloads: 10.3M/month (top 5,000 on PyPI) - Known vulnerabilities: none known ## Tags azure synapse spark client, spark job submission azure, synapse analytics python sdk, azure livy spark api, spark cluster management azure, azure-sdk, spark, cloud-computing [View on SkillFed](https://skillfed.io/packages/azure-synapse-spark) · [View on PyPI](https://pypi.org/project/azure-synapse-spark/)