{"categories":[{"label":"Quality Assurance","url":"https://skillfed.io/packages/category/software-development-quality-assurance/4"}],"enrichment":{"capability":"Provides type stubs for PySpark to enable static type checking and improved IDE autocompletion when working with Apache Spark in Python.","skillfed_tags":["type-checking","static-analysis","spark"],"use_cases":["Catch type errors in PySpark code during development using mypy or similar type checkers before submitting to production.","Improve IDE autocompletion and inline documentation in PyCharm, VS Code, or other editors that support type hints.","Enable static analysis in CI/CD pipelines to enforce type safety on Spark data processing jobs.","Support legacy Spark 2.4 or 3.0 projects that need type hints but cannot upgrade to newer Spark versions with built-in stubs."],"what_it_does":"PySpark Stubs is a collection of type stub files (.pyi) for Apache Spark's Python API, generated by mypy's stubgen tool and manually refined with accurate type hints. It allows developers to use static type checkers like mypy and IDEs like PyCharm to catch type errors in PySpark code before runtime, and enables better autocompletion in editors.\n\nThe package was originally maintained as a standalone project but has been merged into the main Apache Spark repository for versions 3.1 and later. This PyPI package continues to serve Spark 2.4 and 3.0 users, though it is no longer actively developed. Installation overlays the stub files into your PySpark installation directory so type checkers can find them automatically.","worth_installing":"Yes, if you are using Spark 2.4 or 3.0 and want type checking support\u2014but be aware the package is abandoned and no longer receives updates. For Spark 3.1+, use the type hints built into Apache Spark itself instead. The stubs are permissively licensed and install easily, but verify compatibility with your current mypy and PySpark versions before relying on them in production."},"id":"pyspark-stubs","links":{"html":"https://skillfed.io/packages/pyspark-stubs","md":"https://skillfed.io/packages/pyspark-stubs.md","pypi":"https://pypi.org/project/pyspark-stubs/"},"maintenance":{"status":"abandoned"},"meta":{"latest_release":"2022-01-05","license_spdx":null,"license_treatment":"permissive","name":"pyspark-stubs","python_support":"unspecified","summary":"A collection of the Apache Spark stub files"},"popularity":{"monthly_downloads":117589,"position":12156,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"3.0.0.post3"}