snowpark-connect
Snowpark Connect for Spark
Decision gist · record as of 2026-08-14
Yes, if you have Snowflake infrastructure and want to run PySpark workloads against it without managing a Spark cluster. The package is actively maintained, has no known vulnerabilities, and carries a permissive license. The substantial dependency footprint (21 runtime packages) is a trade-off for full Spark Connect support; verify that your Python version and platform are compatible with jpype1 before installing.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python >=3.10 and <3.13.
- Snowflake credentials and connectivity are required to establish a session.
- Low install friction with a pure-Python wheel distribution.
License · maintenance · safety
Apache License, Version 2.0 (permissive) — Licensed under Apache License, Version 2.0 (permissive). You can use, modify, and distribute this package freely in commercial and private projects, subject to license attribution.
last release 2026-08-13 (1 days)
0 known vulnerabilities (OSV.dev, 2026-08-14) · 135,958 downloads/mo, #11,412 on PyPI
Alternatives
Verify before relying
pip install snowpark-connect
from snowpark.connect import Session
session = Session.builder.configs({...}).create()- Whether the 21 runtime dependencies have known compatibility issues on specific platforms.
- Whether Spark Connect protocol support is feature-complete or if certain PySpark operations are not yet pushable to Snowflake.
- Performance characteristics and optimization details for typical workloads compared to traditional Spark clusters.
What it is and what it does
Snowpark Connect for Spark bridges PySpark and Snowflake by implementing the Spark Connect protocol, allowing you to write familiar PySpark code that executes remotely on Snowflake's infrastructure rather than a local or managed Spark cluster. This decoupling means you can leverage Snowflake's governance, security, and scalability without the operational overhead of cluster management. The package supports pushdown optimizations, meaning queries are translated and executed natively in Snowflake where possible.
The package is built on a large dependency stack including jpype1 (for Java interop), py4j (Spark's Python-Java bridge), pandas and pyarrow (for data interchange), and gRPC components (for the Connect protocol). It requires Python >=3.10 and <3.13 and is actively maintained. Installation is straightforward via pip, though the dependency tree is substantial.
Use it for
- Migrate existing PySpark jobs to Snowflake without rewriting code, using Spark Connect as the execution bridge.
- Build data pipelines that combine Snowflake's native SQL performance with PySpark's data transformation flexibility.
- Eliminate Spark cluster provisioning and management overhead by offloading compute to Snowflake's managed infrastructure.
- Integrate Snowflake governance and security policies into Spark-based ETL workflows without separate cluster authentication.
- Prototype and test Spark workloads against Snowflake without standing up a dedicated Spark environment.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you have Snowflake infrastructure and want to run PySpark workloads against it without managing a Spark cluster.
The package is actively maintained, has no known vulnerabilities, and carries a permissive license. The substantial dependency footprint (21 runtime packages) is a trade-off for full Spark Connect support; verify that your Python version and platform are compatible with jpype1 before installing.
Install
snowpark-connect on PyPI
Before you install
Low install friction with a pure-Python wheel distribution. Active maintenance as of 2026-08-13. The package carries 21 runtime dependencies including substantial stacks (jpype1, py4j, pandas, pyarrow, grpcio), so installation will pull a large dependency tree.
Requires Python >=3.10 and <3.13. Snowflake credentials and connectivity are required to establish a session.
License in practice
Licensed under Apache License, Version 2.0 (permissive). You can use, modify, and distribute this package freely in commercial and private projects, subject to license attribution.
Quickstart
pip install snowpark-connect
from snowpark.connect import Session
session = Session.builder.configs({...}).create()Verify before relying
- Whether the 21 runtime dependencies have known compatibility issues on specific platforms.
- Whether Spark Connect protocol support is feature-complete or if certain PySpark operations are not yet pushable to Snowflake.
- Performance characteristics and optimization details for typical workloads compared to traditional Spark clusters.
Package facts
| License | Apache License, Version 2.0 permissive |
| Python support | Capped below the current Python release <3.13,>=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 21 packagessnowpark-connect-deps-1snowpark-connect-deps-2certificloudpicklefsspecjpype1protobufs3fssnowflake.coresnowflake-snowpark-pythonsnowflake-connector-pythonsqlglotaiobotocorepy4jpandaspyarrowgrpciogrpcio-statusgoogleapis-common-protosnumpygcsfs |
| Maintenance | Actively maintained 1 days since the last release |
| First released | |
| Downloads | 135,958 / month, #11,412 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
Evidence: snowpark_connect-1.38.0-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “spark on snowflake”
- snowpark-connectSnowpark Connect for Spark lets you run Spark workloads directly…
- snowpark-connect-deps-1Bundles Apache Spark 3.5.6 JAR files required by Snowpark Connect,…
- datacompyDataComPy compares two DataFrames across Pandas, Polars, Spark, and…
Give your agent the search over MCP, or paste the wish link into any chat.
More Distributed Computing packages
gRPC Python is an HTTP/2-based RPC framework that enables you to define and call remote procedures across network boundaries using protocol buffers for serialization.
Install it if you need RPC communication in a distributed system or are integrating with existing gRPC services.
execnet lets you spawn and communicate with Python interpreters across local processes, remote hosts, and different platforms, using a simple API for task distribution and inter-process messaging.
However, the aging maintenance status (275 days since last release) means you should verify it meets your concurrency and performance needs before committing to a…
Cloudpickle extends Python's standard pickle module to serialize lambda functions, interactively-defined functions and classes, and other constructs that the default pickle cannot handle, making it suitable for cluster computing and remote code execution.
Install it if you need to serialize lambda functions, interactively-defined code, or non-standard Python constructs for cluster computing or distributed execution.
Provides a unified, open()-compatible Python API for streaming large files from remote storage (S3, GCS, Azure, HDFS, SFTP, HTTP) and local filesystems, with transparent compression support.
Install it if you work with large files on cloud storage or remote systems and want to avoid writing boilerplate around multiple SDKs.
Portalocker provides cross-platform file locking with support for exclusive and shared locks, plus Redis-based distributed locks and process-aware PID file locking.
Install it if you need file or process coordination; the optional extras (pywin32, redis) are only required for specific lock types.
Ray is a distributed computing framework that scales Python applications from a single machine to multi-node clusters, providing abstractions for parallel tasks, stateful actors, and shared objects.
See also snowflake-snowpark-python · snowpark-connect-deps-1 · snowflake-cli · pyspark-client · snowpark-connect-deps-2 · pyspark · streamsets · databricks-connect · snowflake · joblibspark