{"categories":[{"label":"Distributed Computing","url":"https://skillfed.io/packages/category/system-distributed-computing/2"}],"enrichment":{"capability":"A Python client for Apache Livy that enables remote code execution on Spark clusters via Livy's REST interface.","skillfed_tags":["spark-integration","abandoned"],"use_cases":["Submit Python code to a remote Spark cluster for distributed execution without SSH or direct cluster access.","Integrate Spark job submission into Python data pipelines or ETL workflows via REST.","Prototype or test Spark jobs from a local development environment against a shared cluster.","Build automation that triggers Spark computations from Python applications."],"what_it_does":"Livy is a Python wrapper around Apache Livy, an open-source REST interface for Spark clusters. It lets you submit and manage Spark jobs from Python without direct cluster access, using HTTP requests under the hood. The package depends on pandas, requests, and dataclasses to handle data serialization, HTTP communication, and Python 3.6 compatibility.\n\nThe package is no longer maintained. Its last commit was 2022-01-05, and the latest release was 2021-01-27. If your Spark and Livy infrastructure has remained stable and compatible with that era, it may still work; otherwise, you risk incompatibility with newer cluster versions or missing security patches.","worth_installing":"No, unless you are locked into a legacy Spark/Livy setup from 2021 or earlier and cannot upgrade. The package is abandoned with no maintenance since 2022, no known vulnerabilities currently reported, but no assurance of compatibility with modern Spark or Livy versions. Consider an actively maintained alternative if possible."},"id":"livy","links":{"html":"https://skillfed.io/packages/livy","md":"https://skillfed.io/packages/livy.md","pypi":"https://pypi.org/project/livy/"},"maintenance":{"status":"abandoned"},"meta":{"latest_release":"2021-01-27","license_spdx":null,"license_treatment":"permissive","name":"livy","python_support":"unspecified","summary":"A Python client for Apache Livy"},"popularity":{"monthly_downloads":288683,"position":8016,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.8.0"}
