prefect-gcp

What it is and what it does

prefect-gcp is an integration package that extends Prefect's workflow orchestration platform with native support for Google Cloud Platform services. It provides blocks, tasks, and utilities to interact with Vertex AI, Cloud Run, BigQuery, Cloud Storage, and Secret Manager directly within Prefect flows, eliminating the need to write custom authentication and API call logic.

The package depends on Prefect itself plus the official Google Cloud client libraries (google-api-python-client, google-cloud-storage, google-cloud-secret-manager) and utility libraries (tenacity for retry logic, python-slugify for name normalization). It's maintained as part of the main Prefect project, receives regular updates, and supports modern Python versions (3.10 through 3.13).

Use it for:

• Orchestrate data pipelines that read from BigQuery, transform data, and write results back to Cloud Storage.
• Deploy containerized workflows to Cloud Run from Prefect flows with automatic credential management.
• Retrieve secrets from Secret Manager within workflow steps without hardcoding credentials.
• Submit machine learning training jobs to Vertex AI and monitor their progress from Prefect.
• Build multi-step GCP workflows that combine services (e.g., fetch data from Storage, process in BigQuery, log to Secret Manager).

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Integrates Prefect workflow orchestration with Google Cloud Platform services including Vertex AI, Cloud Run, BigQuery, Cloud Storage, and Secret Manager.

Yes. This is an actively maintained integration from the Prefect project itself, carries no known vulnerabilities, has low install friction, and is licensed permissively. Install it if you use Prefect and need to orchestrate GCP services; skip it if you don't use Prefect or don't need GCP integration.

Install

prefect-gcp on PyPI

pip install prefect-gcp

uv add prefect-gcp

poetry add prefect-gcp

Installing prefect-gcp

Before you install

Low install friction with a pure Python wheel. Actively maintained with a recent release within 30 days and an active repository. Requires Python 3.10 or later.

License in practice

Apache License 2.0 is permissive; you can use, modify, and distribute this package freely in commercial and private projects with minimal restrictions.

Quickstart

pip install prefect-gcp

from prefect_gcp import GcpCredentials
from prefect import flow

@flow
def my_gcp_flow():
    credentials = GcpCredentials.load("my-gcp-block")
    # Use credentials with GCP tasks

Requires Python 3.10 or later and valid Google Cloud Platform credentials configured.

Verify before relying

• Specific task/block types available beyond the five service categories mentioned (Vertex AI, Cloud Run, BigQuery, Cloud Storage, Secret Manager).
• Whether all six runtime dependencies are required for basic usage or if some are optional per service.

Package facts

Evidence: prefect_gcp-0.6.21-py3-none-any.whl

Keywords: prefect

Tags

More Libraries packages