{"categories":[{"label":"Distributed Computing","url":"https://skillfed.io/packages/category/system-distributed-computing"}],"enrichment":{"capability":"Adds Spark to Python's import path at runtime, making it available as a regular library without manual sys.path manipulation or symlinking.","skillfed_tags":["spark-setup","environment-detection"],"use_cases":["Initialize Spark in a Jupyter notebook without manual environment variable setup.","Automate Spark path detection in a Python script that uses Spark for data processing.","Set up Spark in an IPython profile so it's ready on every interactive session.","Persist Spark environment variables to .bashrc for shell-based Spark workflows."],"what_it_does":"findspark is a small utility that solves a common setup problem: Spark is not on Python's sys.path by default, which makes importing it as a regular library awkward. Instead of manually symlinking or manipulating sys.path yourself, findspark does this at runtime when you call findspark.init(). It searches for a Spark installation using the SPARK_HOME environment variable, common installation paths (like Homebrew's default on macOS), or a path you provide explicitly.\n\nOnce initialized, Spark becomes importable. findspark can also optionally persist configuration to your IPython profile or .bashrc so that the setup happens automatically on startup. It has no runtime dependencies and installs as a pure Python wheel, making it a lightweight addition to any Spark workflow.","worth_installing":"Yes. findspark solves a genuine friction point in Spark setup with zero runtime overhead. It is actively maintained, has no dependencies, carries a permissive license, and is widely used (top 5000 PyPI packages). Install it if you work with Spark and want to avoid manual sys.path or environment variable management."},"id":"findspark","links":{"html":"https://skillfed.io/packages/findspark","md":"https://skillfed.io/packages/findspark.md","pypi":"https://pypi.org/project/findspark/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2022-02-11","license_spdx":null,"license_treatment":"permissive","name":"findspark","python_support":"unspecified","summary":"Find pyspark to make it importable."},"popularity":{"monthly_downloads":2668480,"position":2950,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"2.0.1"}