sagemaker-feature-store-pyspark-3.3

What it is and what it does

This package is a PySpark connector that bridges Apache Spark and Amazon SageMaker FeatureStore, enabling you to push feature data from Spark DataFrames directly into SageMaker's online and offline feature stores. It handles the translation between Spark's distributed data model and SageMaker's feature ingestion API, and includes utilities to automatically load feature definitions to simplify feature group creation.

The connector is designed for batch ingestion workflows where you have feature data in Spark and need to materialize it into SageMaker FeatureStore for model training or serving. It abstracts away the details of the SageMaker API calls, letting you work primarily with familiar Spark DataFrame operations.

Use it for:

• Batch ingest feature data from a Spark cluster into SageMaker FeatureStore's online and offline stores for ML model training.
• Automatically load and register feature definitions from Spark DataFrames to create SageMaker feature groups without manual schema definition.
• Integrate Spark-based ETL pipelines with SageMaker's feature management infrastructure for centralized feature governance.
• Populate both online (low-latency) and offline (batch) feature stores from a single Spark job to keep training and serving features in sync.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

A PySpark connector for Amazon SageMaker FeatureStore that ingests data from Spark DataFrames into FeatureStore's online and offline stores, with automatic feature definition loading.

Yes, if you are already running Spark 3.3 workloads on AWS and need to ingest features into SageMaker FeatureStore—it eliminates manual API calls and simplifies the integration. However, proceed with caution: maintenance is dormant (554 days since last release), so compatibility with recent SageMaker or Spark updates is uncertain. Verify compatibility with your SageMaker API version before adopting in production.

Install

sagemaker-feature-store-pyspark-3-3 on PyPI

pip install sagemaker-feature-store-pyspark-3-3

uv add sagemaker-feature-store-pyspark-3-3

poetry add sagemaker-feature-store-pyspark-3-3

Installing sagemaker-feature-store-pyspark-3.3

Before you install

High install friction due to the distribution format (tar.gz source archive). Maintenance is dormant—no commits tracked and last release was 554 days ago, suggesting the package receives minimal active development or updates.

License in practice

Licensed under Apache License 2.0, a permissive open-source license that allows commercial and private use with minimal restrictions, though you must include a copy of the license and note any modifications.

Quickstart

# Install
pip install sagemaker-feature-store-pyspark-3-3

# Import and use with Spark DataFrame
from sagemaker_feature_store_pyspark import FeatureStoreConnector

# Ingest DataFrame to FeatureStore
connector = FeatureStoreConnector()
connector.ingest_data(spark_dataframe, feature_group_name)

Requires Apache Spark 3.3 and an active AWS SageMaker FeatureStore setup with appropriate IAM credentials configured.

Verify before relying

• Whether PySpark 3.3 is a hard requirement or if the connector works with other Spark versions
• Minimum Python version required (not specified in metadata)
• Current compatibility with recent SageMaker API versions given the dormant maintenance status

Package facts

Evidence: sagemaker_feature_store_pyspark_3_3-1.1.3.tar.gz

Keywords: ML, Amazon, AWS, AI, FeatureStore, SageMaker

Tags

More Artificial Intelligence packages