--- id: aws-parallelcluster version: "3.15.1" license: Apache License 2.0 license_treatment: permissive maintenance: active --- # aws-parallelcluster — AWS ParallelCluster is an AWS supported Open Source cluster management tool to deploy and manage HPC clusters in the AWS cloud. License: permissive · Maintenance: active · Downloads: 93.4K/mo ## What it is and what it does AWS ParallelCluster is an open-source cluster management tool built on the CfnCluster project that automates the deployment of HPC environments on AWS. It handles provisioning of compute resources, shared filesystems, and batch schedulers (such as AWS Batch and Slurm) through a single configuration interface. The tool is designed to support both rapid proof-of-concept deployments and production-scale HPC workloads. The package depends on AWS CDK modules for infrastructure-as-code provisioning, boto3 for AWS API interaction, and Flask/Connexion for its control plane API. It uses Jinja2 for templating, marshmallow for configuration validation, and tabulate for CLI output. This dependency footprint reflects its role as a full-stack cluster orchestration platform rather than a lightweight utility. Use it for: - Deploy a Slurm-based HPC cluster on AWS for scientific computing workloads without manual infrastructure setup. - Build a genomics portal or similar domain-specific workflow platform on top of managed HPC infrastructure. - Rapidly prototype HPC cluster configurations and scale them to production with minimal operational overhead. - Manage multi-node batch processing jobs using AWS Batch as the scheduler backend. - Automate shared filesystem provisioning (EFS, FSx) alongside compute resources for data-intensive applications. ## Worth the install? AI-flagged interpretation of the facts above — verify before relying. AWS ParallelCluster is a cluster management tool that deploys and manages High Performance Computing (HPC) clusters on AWS, automating compute resource setup, shared filesystems, and batch scheduler configuration. Yes—if you need to deploy HPC clusters on AWS. The package is production-stable, actively maintained, has no known vulnerabilities, and carries a permissive license. The 29 runtime dependencies are substantial but reflect the complexity of orchestrating AWS infrastructure; they are not a red flag. Install it if cluster management is your goal; skip it if you only need to run individual EC2 instances or submit jobs to an existing cluster. ## Install pip install aws-parallelcluster uv add aws-parallelcluster poetry add aws-parallelcluster ## Installing aws-parallelcluster Before you install: Low install friction with a pure-Python wheel. Active maintenance with recent commits and 887 repository stars. Supports current Python versions (3.9–3.12) and marked as production-stable. License in practice: Apache License 2.0 (permissive) allows commercial use, modification, and distribution with minimal restrictions—suitable for production deployments without licensing concerns. Quickstart: pip install aws-parallelcluster from aws_parallelcluster import api # Create or update a cluster via the API api.create_cluster(cluster_name='my-hpc', cluster_config={...}) AWS credentials must be configured (via environment variables, ~/.aws/config, or IAM role); an AWS account with appropriate permissions is required. Verify before relying: - Whether the 29 runtime dependencies (including AWS CDK modules and Flask) are all required for basic cluster deployment or only for advanced features. - Whether AWS credentials and account setup are prerequisites beyond the Python environment. ## Package facts - License: Apache License 2.0 (permissive) - Python support: supports_current - Install friction: low - Maintenance: active - Downloads: 93.4K/month (top 15,000 on PyPI) - Known vulnerabilities: none known ## Tags HPC cluster management AWS, deploy compute clusters cloud, batch scheduler AWS, high performance computing infrastructure, cluster orchestration tool, AWS infrastructure automation, slurm batch scheduler, hpc-infrastructure, aws-automation, cluster-orchestration [View on SkillFed](https://skillfed.io/packages/aws-parallelcluster) · [View on PyPI](https://pypi.org/project/aws-parallelcluster/)