--- id: snowpark-connect version: "1.38.0" license: Apache License, Version 2.0 license_treatment: permissive maintenance: active --- # snowpark-connect — Snowpark Connect for Spark License: permissive · Maintenance: active · Downloads: 136.0K/mo ## What it is and what it does Snowpark Connect for Spark bridges PySpark and Snowflake by implementing the Spark Connect protocol, allowing you to write familiar PySpark code that executes remotely on Snowflake's infrastructure rather than a local or managed Spark cluster. This decoupling means you can leverage Snowflake's governance, security, and scalability without the operational overhead of cluster management. The package supports pushdown optimizations, meaning queries are translated and executed natively in Snowflake where possible. The package is built on a large dependency stack including jpype1 (for Java interop), py4j (Spark's Python-Java bridge), pandas and pyarrow (for data interchange), and gRPC components (for the Connect protocol). It requires Python >=3.10 and <3.13 and is actively maintained. Installation is straightforward via pip, though the dependency tree is substantial. Use it for: - Migrate existing PySpark jobs to Snowflake without rewriting code, using Spark Connect as the execution bridge. - Build data pipelines that combine Snowflake's native SQL performance with PySpark's data transformation flexibility. - Eliminate Spark cluster provisioning and management overhead by offloading compute to Snowflake's managed infrastructure. - Integrate Snowflake governance and security policies into Spark-based ETL workflows without separate cluster authentication. - Prototype and test Spark workloads against Snowflake without standing up a dedicated Spark environment. ## Worth the install? AI-flagged interpretation of the facts above — verify before relying. Snowpark Connect for Spark lets you run Spark workloads directly against Snowflake's compute engine using the Spark Connect protocol, without managing a separate Spark cluster. Yes, if you have Snowflake infrastructure and want to run PySpark workloads against it without managing a Spark cluster. The package is actively maintained, has no known vulnerabilities, and carries a permissive license. The substantial dependency footprint (21 runtime packages) is a trade-off for full Spark Connect support; verify that your Python version and platform are compatible with jpype1 before installing. ## Install pip install snowpark-connect uv add snowpark-connect poetry add snowpark-connect ## Installing snowpark-connect Before you install: Low install friction with a pure-Python wheel distribution. Active maintenance as of 2026-08-13. The package carries 21 runtime dependencies including substantial stacks (jpype1, py4j, pandas, pyarrow, grpcio), so installation will pull a large dependency tree. License in practice: Licensed under Apache License, Version 2.0 (permissive). You can use, modify, and distribute this package freely in commercial and private projects, subject to license attribution. Quickstart: pip install snowpark-connect from snowpark.connect import Session session = Session.builder.configs({...}).create() Requires Python >=3.10 and <3.13. Snowflake credentials and connectivity are required to establish a session. Verify before relying: - Whether the 21 runtime dependencies have known compatibility issues on specific platforms. - Whether Spark Connect protocol support is feature-complete or if certain PySpark operations are not yet pushable to Snowflake. - Performance characteristics and optimization details for typical workloads compared to traditional Spark clusters. ## Package facts - License: Apache License, Version 2.0 (permissive) - Python support: capped_below_current - Install friction: low - Maintenance: active - Downloads: 136.0K/month (top 15,000 on PyPI) - Known vulnerabilities: none known ## Tags spark on snowflake, snowpark connect, spark connect protocol, pyspark snowflake integration, remote spark execution, snowflake compute engine, spark cluster alternative, spark-integration, data-warehouse [View on SkillFed](https://skillfed.io/packages/snowpark-connect) · [View on PyPI](https://pypi.org/project/snowpark-connect/)