qds-sdk

What it is and what it does

qds-sdk is a Python client library for the Qubole Data Service, a cloud-based big data platform. It provides both a command-line tool (qds.py) and a programmatic API for submitting and monitoring data processing jobs—Hive queries, Hadoop streaming jobs, Pig scripts, Presto queries, and shell commands—against a Qubole cluster. The SDK handles authentication via API tokens and abstracts away HTTP communication through its runtime dependencies (requests, boto3, urllib3).

The package is designed for developers integrating Qubole into Python applications or automation workflows. It supports synchronous command execution (wait for results) and asynchronous submission (check status later). The CLI tool can be invoked directly from the shell, while the SDK API allows programmatic control within Python code. The codebase is aging—last updated 526 days ago—and the original maintainers have moved on after Qubole's acquisition, though the repository remains accessible and the package still installs cleanly on modern Python versions.

Use it for:

• Run Hive queries against a Qubole cluster from a Python script and retrieve results programmatically.
• Submit Hadoop streaming jobs with custom mappers and reducers to process large datasets in S3.
• Build data pipeline orchestration tools that execute Presto queries and monitor their status via the SDK.
• Automate shell command execution on Qubole infrastructure as part of a larger data workflow.
• Integrate Qubole job submission into CI/CD or data processing automation without direct HTTP calls.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

A Python SDK for authenticating with and executing commands against the Qubole Data Service API, supporting Hive, Hadoop, Pig, Presto, and Shell commands via both CLI and programmatic interfaces.

Yes, if you are an existing Qubole customer and need a Python client to interact with your cluster. The package installs cleanly, has no security vulnerabilities, and supports modern Python versions. However, be aware that it is aging—the last release was 526 days ago and the original maintainers have moved on—so expect limited support for new features or breaking API changes. Use it for integration with an established Qubole deployment, not as a foundation for new big data infrastructure.

Install

qds-sdk on PyPI

pip install qds-sdk

uv add qds-sdk

poetry add qds-sdk

Installing qds-sdk

Before you install

Low friction install with no compiled dependencies. The package is aging—last release was 526 days ago—and the maintainers have moved on since Qubole's acquisition, though the repository remains active and the codebase supports current Python versions.

License in practice

Licensed under Apache License 2.0 (permissive), so you can use, modify, and distribute the package freely in commercial and open-source projects without significant legal restrictions.

Quickstart

pip install qds-sdk

from qds_sdk.qubole import Qubole
from qds_sdk.commands import HiveCommand

Qubole.configure(api_token='your_token')
hc = HiveCommand.create(query='show tables')
print(f"Id: {hc.id}, Status: {hc.status}")

Requires a valid Qubole API token and network access to a Qubole Data Service instance (api.qubole.com or custom endpoint).

Verify before relying

• Whether the package is actively maintained post-acquisition or in maintenance-only mode for existing users.
• Current compatibility with modern Qubole API versions and any breaking changes since the last release.

Package facts

Evidence: qds_sdk-1.17.0-py3-none-any.whl

Keywords: qubole, sdk, api

Tags

More Front-Ends packages