{"categories":[{"label":"Distributed Computing","url":"https://skillfed.io/packages/category/system-distributed-computing"}],"enrichment":{"capability":"HdfsCLI provides Python bindings and a command-line interface for interacting with HDFS clusters via the WebHDFS API, supporting file operations, metadata queries, and an interactive shell.","skillfed_tags":["hdfs-client","hadoop-integration","cli-tool"],"use_cases":["Batch upload or download files to/from HDFS in Python scripts without writing Java code.","Query HDFS file metadata (permissions, replication, block size) programmatically from Python.","Load Pandas dataframes directly from HDFS files using the optional dataframe extension.","Automate HDFS file operations in data pipelines using the Python API.","Interactively explore HDFS directory structure and file contents via the CLI shell."],"what_it_does":"HdfsCLI is a Python library and CLI tool that wraps the WebHDFS API to let you interact with Hadoop Distributed File System clusters. It provides both programmatic access\u2014listing directories, reading and writing files, checking file metadata\u2014and an interactive shell for ad-hoc exploration. The package supports both secure and insecure clusters, and includes optional extensions for Avro serialization and Pandas dataframe integration.\n\nThe library is marked Production/Stable and supports Python 3.7, 3.8, 3.9, 3.10, 3.11, and 3.12, but has not been actively maintained since 2023-10-13. It carries no known security vulnerabilities. Installation requires building from source, which adds friction. If your HDFS cluster is stable and your use case is straightforward file operations, the dormant status may not matter; if you need active support or are integrating with rapidly evolving Hadoop ecosystems, the lack of maintenance is a significant risk.","worth_installing":"Yes, if you have a stable HDFS cluster and need straightforward Python access to it. The MIT license is permissive, there are no known vulnerabilities, and the API is mature. However, the package is dormant, so expect no active support or fixes for new Hadoop versions. Suitable for legacy systems or simple use cases; risky for new projects expecting ongoing maintenance."},"id":"hdfs","links":{"html":"https://skillfed.io/packages/hdfs","md":"https://skillfed.io/packages/hdfs.md","pypi":"https://pypi.org/project/hdfs/"},"maintenance":{"status":"dormant"},"meta":{"latest_release":"2023-10-13","license_spdx":null,"license_treatment":"permissive","name":"hdfs","python_support":"unspecified","summary":"HdfsCLI: API and command line interface for HDFS."},"popularity":{"monthly_downloads":6220079,"position":1955,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"2.7.3"}
