skillfed

Distributed Computing packages

295 packages · page 2 of 3

Packages

  • k8s-agent-sandbox

    A Python client library for creating and…

    permissive · active · 648.8K/mo

  • dagster-pyspark

    Integrates PySpark with Dagster's data pipeline…

    permissive · active · 632.1K/mo

  • flameprof

    Converts Python cProfile statistics into…

    permissive · abandoned · 621.8K/mo

  • dagster-snowflake

    Integrates Snowflake with Dagster's data…

    permissive · active · 613.5K/mo

  • cwsandbox

    A Python client library for running and…

    permissive · active · 602.3K/mo

  • dagster-databricks

    Integrates Databricks with Dagster's data…

    permissive · active · 576.5K/mo

  • django-q2

    Django Q2 is a multiprocessing distributed task…

    permissive · active · 571.3K/mo

  • dagster-spark

    Dagster-spark integrates Apache Spark with…

    permissive · active · 563.6K/mo

  • pottery

    Pottery provides Python dict, set, list, deque,…

    unclear · active · 557.2K/mo

  • nvshmem4py-cu13

    Provides a Python interface to NVSHMEM,…

    unclear · active · 552.9K/mo

  • oslo.concurrency

    oslo.concurrency provides locking mechanisms…

    permissive · active · 549.8K/mo

  • python-novaclient

    Python bindings to the OpenStack Compute API,…

    permissive · active · 539.2K/mo

  • python-cinderclient

    Python bindings and command-line interface to…

    permissive · active · 533.6K/mo

  • python-dynamodb-lock

    Provides distributed locking on top of DynamoDB…

    permissive · dormant · 519.5K/mo

  • oslo.messaging

    Oslo Messaging provides a unified API for RPC…

    permissive · active · 502.2K/mo

  • futurist

    Futurist provides futures utilities and…

    permissive · active · 501.1K/mo

  • dagit

    Dagit is the web UI for Dagster, providing a…

    permissive · active · 498.2K/mo

  • xgboost-ray

    Distributes XGBoost training and inference…

    permissive · abandoned · 462.2K/mo

  • azure-eventhub-checkpointstoreblob

    Provides a checkpoint store implementation for…

    permissive · active · 445.1K/mo

  • rq-dashboard

    A Flask-based web dashboard for monitoring RQ…

    permissive · active · 434.2K/mo

  • dapr

    Dapr SDK for Python provides client libraries…

    permissive · active · 419.4K/mo

  • bounded-pool-executor

    Wraps Python's ProcessPoolExecutor and…

    permissive · dormant · 417.8K/mo

  • azure-mgmt-automation

    Provides Python client library for managing…

    permissive · active · 409.7K/mo

  • lightkube-models

    Provides Python type definitions and model…

    permissive · active · 407.4K/mo

  • cityhash

    Python wrapper for Google's CityHash and…

    permissive · aging · 406.4K/mo

  • faktory

    A Python worker and client library for Faktory,…

    permissive · dormant · 405.5K/mo

  • fal

    fal is a serverless Python runtime that…

    unclear · active · 392.0K/mo

  • pqdm

    pqdm wraps tqdm and concurrent.futures to…

    permissive · dormant · 390.4K/mo

  • durabletask

    Durabletask is a Python SDK for building…

    permissive · active · 388.0K/mo

  • faust-streaming

    Faust-streaming is a Python library for…

    permissive · active · 387.9K/mo

  • aiometer

    aiometer is a concurrency scheduling library…

    permissive · aging · 386.1K/mo

  • mwaa-dr

    Generates backup, restore, and cleanup DAGs for…

    unclear · active · 384.2K/mo

  • durabletask.azuremanaged

    Provides a Python provider implementation for…

    permissive · active · 382.2K/mo

  • Pyro5

    Pyro5 enables remote method calls on Python…

    permissive · active · 374.1K/mo

  • pulumi-eks

    Pulumi component for provisioning and managing…

    permissive · active · 366.5K/mo

  • dagster-dlt

    Integrates dlt data loading into Dagster…

    permissive · active · 357.3K/mo

  • celery-singleton

    Prevents duplicate Celery tasks from being…

    permissive · abandoned · 352.8K/mo

  • argo-workflows

    Provides Python API bindings for Argo…

    unclear · active · 345.1K/mo

  • dask-image

    Distributed image processing using Dask,…

    permissive · active · 326.8K/mo

  • opencode-agent-hub

    Coordinates communication between multiple AI…

    agpl · active · 308.4K/mo

  • dagster-azure

    Provides Azure-specific integrations for…

    permissive · active · 306.7K/mo

  • dagster-shell

    Provides shell operation support for Dagster…

    permissive · active · 306.2K/mo

  • k8

    Provides Python type models for Kubernetes…

    permissive · dormant · 305.1K/mo

  • cwltool

    cwltool is the reference implementation of the…

    permissive · active · 294.7K/mo

  • livy

    A Python client for Apache Livy that enables…

    permissive · abandoned · 288.7K/mo

  • h2o-wave

    H2O Wave is a Python framework for building…

    permissive · active · 277.7K/mo

  • celery_once

    Prevents duplicate execution and queuing of…

    permissive · abandoned · 275.5K/mo

  • mooncake-transfer-engine

    Mooncake Transfer Engine provides…

    permissive · active · 271.0K/mo

  • atomic_dict

    Atomic-Dict provides a lock-free, shared 64-bit…

    permissive · dormant · 266.0K/mo

  • kfp-kubernetes

    Extends Kubeflow Pipelines SDK with…

    permissive · active · 265.7K/mo

  • pgqueuer

    PgQueuer turns PostgreSQL into a background job…

    permissive · active · 261.9K/mo

  • ClusterShell

    ClusterShell is a Python framework for running…

    copyleft · active · 260.8K/mo

  • python-etcd

    A Python client library for etcd, a distributed…

    permissive · dormant · 257.1K/mo

  • dagster-duckdb

    Integrates DuckDB with Dagster's data pipeline…

    permissive · active · 256.1K/mo

  • drjax

    DrJAX embeds MapReduce programming primitives…

    permissive · active · 253.4K/mo

  • pykube-ng

    pykube-ng is a Python client library for…

    permissive · abandoned · 252.9K/mo

  • rapids-dask-dependency

    Pins compatible versions of dask and…

    permissive · active · 251.6K/mo

  • yarn-api-client

    Python client library for querying and managing…

    permissive · abandoned · 250.4K/mo

  • etcd-sdk-python

    Python client for etcd v3 API that provides…

    permissive · aging · 250.1K/mo

  • redlock-py

    Implements Redis-based distributed locks using…

    permissive · abandoned · 246.9K/mo

  • django-celery-email

    Routes Django email sending through Celery task…

    permissive · abandoned · 233.5K/mo

  • juju

    A Python library providing asynchronous…

    permissive · abandoned · 233.2K/mo

  • lithops

    Lithops is a Python framework for running…

    permissive · active · 233.1K/mo

  • cwl-utils

    Loads, parses, and manipulates Common Workflow…

    permissive · active · 230.2K/mo

  • saq

    SAQ is an async job queue framework that runs…

    permissive · active · 225.3K/mo

  • python-heatclient

    Python client library and command-line tool for…

    permissive · active · 220.6K/mo

  • condor-git-config

    Provides an executable hook that fetches…

    permissive · abandoned · 215.6K/mo

  • apache-flink

    Python API for Apache Flink that builds…

    permissive · active · 214.1K/mo

  • dagster-snowflake-pandas

    Integrates Snowflake and Pandas with Dagster's…

    permissive · active · 213.8K/mo

  • kafka-connect-py

    A command-line tool and Python client for…

    permissive · aging · 212.4K/mo

  • aws-durable-execution-sdk-python

    Builds long-running AWS Lambda workflows with…

    permissive · active · 210.9K/mo

  • dagster-airbyte

    Integrates Airbyte data connectors with…

    permissive · active · 206.5K/mo

  • IxNetwork

    IxNetwork is a Python client library for…

    permissive · dormant · 202.6K/mo

  • bernstein

    Bernstein orchestrates parallel CLI coding…

    permissive · active · 199.6K/mo

  • zenml

    ZenML is an MLOps orchestration platform that…

    permissive · active · 198.6K/mo

  • cotyledon

    Cotyledon provides a framework for building…

    permissive · active · 198.4K/mo

  • celery-batches

    Celery Batches provides a Task class that…

    permissive · active · 197.1K/mo

  • hyperlight-sandbox-python-guest

    Provides a Python guest runtime for the…

    permissive · active · 196.8K/mo

  • ansys-platform-instancemanagement

    PyPIM provides a Python client to communicate…

    permissive · active · 192.7K/mo

  • ipyparallel

    Manages clusters of IPython processes for…

    permissive · active · 192.2K/mo

  • kafka-schema-registry

    Integrates Kafka with Confluent Schema Registry…

    permissive · aging · 186.7K/mo

  • raft-dask-cu12

    Provides multi-node multi-GPU distributed…

    permissive · active · 186.3K/mo

  • mitogen

    Mitogen is a library for writing distributed…

    permissive · active · 185.0K/mo

  • dapr-ext-workflow

    Extends the Dapr Python SDK with workflow…

    permissive · active · 184.4K/mo

  • oslo.versionedobjects

    oslo.versionedobjects provides a versioned…

    permissive · active · 180.8K/mo

  • globus-sdk

    Provides a Python interface to Globus APIs for…

    permissive · active · 179.5K/mo

  • Pyro4

    Pyro4 enables Python objects to communicate…

    permissive · abandoned · 177.2K/mo

  • taskflow

    TaskFlow is a library for defining and…

    permissive · active · 176.4K/mo

  • vmware-vapi-runtime

    VMware vAPI Runtime provides HTTP client,…

    permissive · active · 174.1K/mo

  • flyte

    Flyte is a Python SDK for defining,…

    unclear · active · 173.4K/mo

  • vmware-vcenter

    Provides Python bindings to VMware vCenter…

    permissive · active · 172.8K/mo

  • p-tqdm

    p_tqdm wraps pathos and tqdm to apply a…

    permissive · dormant · 172.2K/mo

  • vmware-vapi-common-client

    Provides Python client bindings for VMware vAPI…

    permissive · active · 171.9K/mo

  • python-ironicclient

    Python client library and CLI for the OpenStack…

    permissive · active · 171.8K/mo

  • repartipy

    RepartiPy calculates optimal partition counts…

    permissive · dormant · 171.3K/mo

  • tqdm-joblib

    Adds a progress bar to joblib.Parallel…

    unclear · aging · 169.3K/mo

  • distributed-ucxx-cu12

    Provides a high-performance UCX communication…

    permissive · active · 167.4K/mo

  • azure-mgmt-streamanalytics

    Provides Python client library for managing…

    permissive · active · 165.7K/mo

  • clusterscope

    Clusterscope extracts and queries information…

    permissive · active · 165.0K/mo

  • outerbounds

    Outerbounds is the main platform package that…

    unclear · active · 164.4K/mo

  • pyhelm3

    pyhelm3 is a Python library for…

    permissive · active · 162.5K/mo

  • blaxel

    Python SDK for creating, managing, and…

    unclear · active · 162.4K/mo

  • torchrunx

    torchrunx distributes PyTorch training…

    copyleft · active · 161.4K/mo

  • redlock

    Implements the RedLock algorithm to provide…

    permissive · abandoned · 160.8K/mo

  • tensorizer

    Serializes and deserializes PyTorch modules and…

    permissive · active · 160.4K/mo

  • qiskit-connector

    Automates IBM Quantum backend connection,…

    permissive · aging · 160.2K/mo

  • tooz

    Tooz provides a coordination API for…

    permissive · active · 158.6K/mo

  • mooncake-transfer-engine-cuda13

    Mooncake Transfer Engine provides…

    permissive · active · 158.0K/mo

  • ytsaurus-yson

    Provides C++ bindings for serializing and…

    permissive · aging · 150.2K/mo

  • python-qpid-proton

    Provides Python bindings to Qpid Proton, an…

    permissive · aging · 148.8K/mo

  • airflow-provider-hightouch

    Provides Airflow operators and hooks to trigger…

    permissive · active · 148.2K/mo

  • dagster-mlflow

    Integrates MLflow experiment tracking and model…

    permissive · active · 144.5K/mo

  • kailash-enterprise

    A Rust-compiled workflow orchestration engine…

    unclear · active · 141.6K/mo

  • apache-flink-libraries

    Bundles Apache Flink's required libraries for…

    permissive · active · 140.1K/mo

  • nominal-streaming

    Streams time-series data to Nominal Core with…

    permissive · active · 138.2K/mo

  • snowpark-connect

    Snowpark Connect for Spark lets you run Spark…

    permissive · active · 136.0K/mo

  • sentry-kafka-schemas

    Provides Kafka topic definitions and JSON…

    unclear · active · 135.7K/mo

  • thespian

    Thespian provides an Actor Model framework for…

    permissive · aging · 135.1K/mo

  • kcli

    kcli is a command-line provisioning and…

    unclear · active · 134.7K/mo

  • tensorlake

    Tensorlake provides a Python SDK for building…

    unclear · active · 134.3K/mo