findspark

What it is and what it does

findspark is a small utility that solves a common setup problem: Spark is not on Python's sys.path by default, which makes importing it as a regular library awkward. Instead of manually symlinking or manipulating sys.path yourself, findspark does this at runtime when you call findspark.init(). It searches for a Spark installation using the SPARK_HOME environment variable, common installation paths (like Homebrew's default on macOS), or a path you provide explicitly.

Once initialized, Spark becomes importable. findspark can also optionally persist configuration to your IPython profile or .bashrc so that the setup happens automatically on startup. It has no runtime dependencies and installs as a pure Python wheel, making it a lightweight addition to any Spark workflow.

Use it for:

• Initialize Spark in a Jupyter notebook without manual environment variable setup.
• Automate Spark path detection in a Python script that uses Spark for data processing.
• Set up Spark in an IPython profile so it's ready on every interactive session.
• Persist Spark environment variables to .bashrc for shell-based Spark workflows.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Adds Spark to Python's import path at runtime, making it available as a regular library without manual sys.path manipulation or symlinking.

Yes. findspark solves a genuine friction point in Spark setup with zero runtime overhead. It is actively maintained, has no dependencies, carries a permissive license, and is widely used (top 5000 PyPI packages). Install it if you work with Spark and want to avoid manual sys.path or environment variable management.

Install

findspark on PyPI

pip install findspark

uv add findspark

poetry add findspark

Installing findspark

Before you install

Low friction install with no runtime dependencies. Actively maintained; last commit 2026-03-01 with 525 repository stars.

License in practice

BSD (3-clause) permissive license allows use in most projects without significant restrictions.

Quickstart

pip install findspark

import findspark
findspark.init()

import findspark
findspark.find()

Requires a Spark installation on the system; findspark locates it but does not provide it.

Verify before relying

• Compatibility with modern Spark versions given the last release was 2022-02-11.
• Python version compatibility beyond 'unspecified' in the fact sheet.
• Whether the package works with all common Spark installation methods.

Package facts

Evidence: findspark-2.0.1-py2.py3-none-any.whl

Tags

More Distributed Computing packages