dbt-glue
dbt adapter for AWS Glue
Decision gist · record as of 2026-08-14
Yes, if you are already running AWS Glue and want to adopt dbt for transformation orchestration and testing. The adapter is actively maintained, has low install friction, and permissive licensing. However, verify that your use case aligns with Spark's capabilities and Glue's cost model, and confirm production-readiness expectations given the Beta status.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.9 or later; AWS credentials and IAM permissions for Glue, Lake Formation, and S3 access must be configured; boto3 and AWS CLI setup recommended.
- Low install friction with a pure Python wheel.
- Active maintenance with recent commits and a stable release cadence; marked as Beta status.
License · maintenance · safety
permissive license (permissive) — Permissive license treatment means you can use this adapter in commercial and proprietary projects without significant legal constraints.
last release 2026-02-18 (177 days) · last repo commit 2026-08-14 · 145 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 361,629 downloads/mo, #7,237 on PyPI
Alternatives
Verify before relying
pip install dbt-glue
# In profiles.yml:
type: glue
role_arn: arn:aws:iam::ACCOUNT:role/GlueRole
region: us-east-1
schema: dbt_demo
location: s3://bucket/path- Whether the adapter supports all dbt features or has known limitations in Spark/Glue compatibility.
- Performance characteristics and cost implications of running dbt models through Glue Interactive Sessions.
- Maturity level beyond 'Beta' status and production-readiness guarantees.
What it is and what it does
dbt-glue bridges dbt's transformation framework with AWS Glue's managed Spark engine, letting data teams write dbt models that execute as Spark jobs on Glue. It implements the dbt adapter protocol to translate dbt's SQL and Jinja templates into Spark-compatible operations, handling table creation, partitioning, and metadata management through Glue's catalog and Lake Formation permissions.
The adapter integrates with Glue Interactive Sessions, meaning your dbt runs spin up Spark clusters on demand rather than requiring persistent infrastructure. It depends on dbt-core, dbt-spark, boto3, and pyarrow, and requires AWS IAM roles and S3 bucket access for both metadata and data storage. Configuration happens through standard dbt profiles, specifying your Glue role, region, worker count, and S3 location for output data.
Use it for
- Transform raw data in S3 using dbt models, with results catalogued in Glue and queryable via Athena or other tools.
- Build ELT pipelines that cleanse and denormalize data in place using Spark, coordinated through dbt's DAG and testing framework.
- Manage data lake transformations with Lake Formation permissions, using dbt to orchestrate schema and table updates.
- Run scheduled dbt jobs on AWS Glue without managing Spark clusters, leveraging Glue's serverless session provisioning.
- Integrate dbt workflows into AWS data platforms that already use Glue for ETL, unifying transformation logic.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are already running AWS Glue and want to adopt dbt for transformation orchestration and testing.
The adapter is actively maintained, has low install friction, and permissive licensing. However, verify that your use case aligns with Spark's capabilities and Glue's cost model, and confirm production-readiness expectations given the Beta status.
Install
dbt-glue on PyPI
Before you install
Low install friction with a pure Python wheel. Active maintenance with recent commits and a stable release cadence; marked as Beta status. Requires dbt-core, dbt-spark, and AWS SDK dependencies (boto3), all of which are well-maintained.
Requires Python 3.9 or later; AWS credentials and IAM permissions for Glue, Lake Formation, and S3 access must be configured; boto3 and AWS CLI setup recommended.
License in practice
Permissive license treatment means you can use this adapter in commercial and proprietary projects without significant legal constraints.
Quickstart
pip install dbt-glue
# In profiles.yml:
type: glue
role_arn: arn:aws:iam::ACCOUNT:role/GlueRole
region: us-east-1
schema: dbt_demo
location: s3://bucket/pathVerify before relying
- Whether the adapter supports all dbt features or has known limitations in Spark/Glue compatibility.
- Performance characteristics and cost implications of running dbt models through Glue Interactive Sessions.
- Maturity level beyond 'Beta' status and production-readiness guarantees.
Package facts
| License | permissive license permissive |
| Python support | Supports the current Python release >=3.9 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 7 packagesdbt-coredbt-sparkdbt-commondbt-adapterswaiterpyarrowboto3 |
| Maintenance | Actively maintained 177 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 361,629 / month, #7,237 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaLicense :: OSI Approved :: Apache Software LicenseOperating System :: MacOS :: MacOS XOperating System :: Microsoft :: WindowsOperating System :: POSIX :: LinuxProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.9 |
Evidence: dbt_glue-1.10.19-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “dbt adapter aws glue”
- dbt-gluedbt-glue is a dbt adapter that enables running dbt transformations…
- dbt-athenadbt-athena is a dbt adapter that enables data transformation…
- dbt-athena-communityA dbt adapter that enables data transformation workflows on AWS…
Give your agent the search over MCP, or paste the wish link into any chat.
More Database packages
psycopg2-binary is a PostgreSQL database adapter for Python that implements the DB API 2.0 specification, enabling Python applications to connect to and query PostgreSQL databases with thread-safe concurrent operations.
Python client library for connecting to and executing commands against Redis key-value stores, supporting both synchronous and asynchronous operations.
Install it if your application needs to interact with Redis; the only prerequisite is a running Redis server instance.
YDB Python SDK is the official client library for connecting to and querying YDB databases from Python applications.
Install it if you need to connect Python applications to YDB databases.
Connects Python applications to Snowflake data warehouses using the DB API 2.0 specification, enabling SQL queries, data transfers, and warehouse operations.
sqlparse tokenizes SQL text into a tree of statements, clauses, and expressions, and provides functions to split scripts, format queries, and inspect parsed tokens without validating dialect or syntax.
Install it if you need to manipulate, format, or analyze SQL text programmatically.
Provides base adapter protocols and shared functionality that database adapters use to integrate with dbt-core, handling connections, dialect translation, relation caching, and core interface management.
See also dbt-bigquery · awsglue-dev · dbt-snowflake · dbt-postgres · dbt-spark · dbt-redshift · aws-cdk.aws-glue-alpha · dbt-athena · dbt-state · pulp-glue