{"categories":[{"label":"Database","url":"https://skillfed.io/packages/category/database/3"}],"enrichment":{"capability":"dbt-glue is a dbt adapter that enables running dbt transformations against AWS Glue's Spark engine using the Glue Interactive Sessions API.","skillfed_tags":["aws-glue","dbt-adapter","spark-etl"],"use_cases":["Transform raw data in S3 using dbt models, with results catalogued in Glue and queryable via Athena or other tools.","Build ELT pipelines that cleanse and denormalize data in place using Spark, coordinated through dbt's DAG and testing framework.","Manage data lake transformations with Lake Formation permissions, using dbt to orchestrate schema and table updates.","Run scheduled dbt jobs on AWS Glue without managing Spark clusters, leveraging Glue's serverless session provisioning.","Integrate dbt workflows into AWS data platforms that already use Glue for ETL, unifying transformation logic."],"what_it_does":"dbt-glue bridges dbt's transformation framework with AWS Glue's managed Spark engine, letting data teams write dbt models that execute as Spark jobs on Glue. It implements the dbt adapter protocol to translate dbt's SQL and Jinja templates into Spark-compatible operations, handling table creation, partitioning, and metadata management through Glue's catalog and Lake Formation permissions.\n\nThe adapter integrates with Glue Interactive Sessions, meaning your dbt runs spin up Spark clusters on demand rather than requiring persistent infrastructure. It depends on dbt-core, dbt-spark, boto3, and pyarrow, and requires AWS IAM roles and S3 bucket access for both metadata and data storage. Configuration happens through standard dbt profiles, specifying your Glue role, region, worker count, and S3 location for output data.","worth_installing":"Yes, if you are already running AWS Glue and want to adopt dbt for transformation orchestration and testing. The adapter is actively maintained, has low install friction, and permissive licensing. However, verify that your use case aligns with Spark's capabilities and Glue's cost model, and confirm production-readiness expectations given the Beta status."},"id":"dbt-glue","links":{"html":"https://skillfed.io/packages/dbt-glue","md":"https://skillfed.io/packages/dbt-glue.md","pypi":"https://pypi.org/project/dbt-glue/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-02-18","license_spdx":null,"license_treatment":"permissive","name":"dbt-glue","python_support":"supports_current","summary":"dbt adapter for AWS Glue"},"popularity":{"monthly_downloads":361629,"position":7237,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.10.19"}
