--- id: aws-cdk-aws-glue-alpha version: "2.265.0a0" license: Apache-2.0 license_treatment: permissive maintenance: active --- # aws-cdk.aws-glue-alpha — The CDK Construct Library for AWS::Glue License: permissive · Maintenance: active · Downloads: 1.7M/mo ## What it is and what it does aws-cdk-aws-glue-alpha is an AWS CDK L2 construct library that wraps AWS Glue job creation with higher-level abstractions. It provides opinionated Python classes (PySparkEtlJob, PySparkStreamingJob, PythonShellJob, FlexJob) that set required parameters to AWS best-practice defaults—such as enabling metrics, Spark UI, and continuous CloudWatch logging—while allowing optional overrides for flexibility. The library enforces parameter combinations via interface contracts rather than runtime validation, discouraging anti-patterns and reducing development time. The package is part of the AWS CDK project and targets developers building data integration pipelines on AWS. It handles Spark (ETL and Streaming), Python Shell, and Flex job types, with support for features like Secrets Manager integration for JDBC connections, autoscaling, and security configurations. The APIs are experimental and subject to breaking changes; the library does not support deprecated Glue versions or outdated language dependencies, steering users toward current best practices. Use it for: - Define Spark ETL jobs in Python or Scala with sensible defaults and optional worker type, Glue version, and timeout overrides. - Create Spark Streaming jobs for real-time data processing with structured streaming, using the same opinionated construct pattern. - Build Python Shell jobs for lightweight data transformation tasks without the overhead of full Spark clusters. - Set up Flex jobs for non-urgent workloads (testing, pre-production) with reduced cost via flexible execution class. - Integrate Glue jobs into CDK stacks alongside other AWS resources, with automatic IAM role and security configuration management. ## Worth the install? AI-flagged interpretation of the facts above — verify before relying. Provides AWS CDK L2 constructs for defining AWS Glue jobs (Spark ETL, Spark Streaming, Python Shell, and Flex) with sensible defaults and opinionated interfaces that enforce best practices. Yes, with conditions. Install if you are building AWS Glue jobs within an AWS CDK project and want opinionated, best-practice defaults that reduce boilerplate. Be aware that the APIs are experimental (Beta status) and subject to breaking changes; review release notes before upgrading. No known security vulnerabilities as of the latest check. Low install friction and active maintenance make it a reasonable choice for new CDK-based Glue deployments. ## Install pip install aws-cdk-aws-glue-alpha uv add aws-cdk-aws-glue-alpha poetry add aws-cdk-aws-glue-alpha ## Installing aws-cdk.aws-glue-alpha Before you install: Low install friction with four runtime dependencies. Actively maintained; released 1 day ago with recent commits. Beta stability status means APIs are experimental and subject to non-backward compatible changes in future versions. License in practice: Licensed under Apache-2.0 (permissive), allowing commercial use, modification, and distribution with minimal restrictions. Quickstart: pip install aws-cdk-aws-glue-alpha import aws_cdk as cdk from aws_cdk.aws_glue_alpha import PySparkEtlJob stack = cdk.Stack() glue_job = PySparkEtlJob(stack, "MyJob", role=iam_role, script=glue.Code.from_asset("script.py"), job_name="MyGlueJob" ) Requires Python 3.10 or later; aws-cdk-lib and constructs must be installed as runtime dependencies. Verify before relying: - Whether breaking changes from the prior glue-alpha module require significant code migration for existing users. - Performance characteristics and scalability limits for large numbers of concurrent Glue jobs defined via this construct. - Stability timeline: when these experimental APIs are expected to move out of beta. ## Package facts - License: Apache-2.0 (permissive) - Python support: supports_current - Install friction: low - Maintenance: active - Downloads: 1.7M/month (top 5,000 on PyPI) - Known vulnerabilities: none known ## Tags aws glue job cdk construct, spark etl infrastructure as code, serverless data integration aws, glue streaming job definition, aws cdk glue automation, aws-cdk, data-integration, infrastructure-as-code [View on SkillFed](https://skillfed.io/packages/aws-cdk-aws-glue-alpha) · [View on PyPI](https://pypi.org/project/aws-cdk-aws-glue-alpha/)