azureml-dataprep-rslex

What it is and what it does

Azure Machine Learning Data Prep RsLex is a Rust-based backend for the Azure ML Data Prep SDK, designed to accelerate data operations in machine learning workflows. It provides compiled implementations of data loading, transformation, and writing capabilities that the Data Prep SDK can invoke when explicitly enabled. The package itself is not meant for direct use; instead, it acts as an optional performance layer that sits behind the azureml-dataprep Python API.

Developers working with Azure ML can opt into RsLex execution by calling use_rust_execution(True) in their Data Prep code, which routes operations to this Rust implementation rather than the default Python execution path. The package is actively maintained and available for Python 3.7 through 3.13 across macOS, Windows, and Linux platforms.

Use it for:

• Accelerate large-scale data loading and transformation in Azure ML training pipelines by enabling Rust execution.
• Optimize data preparation workflows that process high-volume datasets by switching to the compiled backend.
• Support cross-platform ML data pipelines on macOS, Windows, and Linux with consistent Rust-based performance.
• Reduce latency in iterative data exploration and feature engineering within Azure ML notebooks.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

A Rust-based execution engine for Azure Machine Learning Data Prep that accelerates data loading, transformation, and writing operations in ML workflows.

Yes, if you are already using azureml-dataprep and need faster data operations. Install it as a dependency of azureml-dataprep rather than directly, then enable Rust execution in your code. The package is actively maintained, has no known vulnerabilities, and adds no direct runtime dependencies. The main caveat is that the license treatment is unclear—verify Microsoft's terms before use in commercial or redistributed projects.

Install

azureml-dataprep-rslex on PyPI

pip install azureml-dataprep-rslex

uv add azureml-dataprep-rslex

poetry add azureml-dataprep-rslex

Installing azureml-dataprep-rslex

Before you install

Medium install friction due to compiled wheels for multiple Python versions and platforms. Active maintenance with a recent release (18 days old). No runtime dependencies, which simplifies integration.

License in practice

License treatment is unclear—no SPDX identifier or raw license text is available. The package is marked as proprietary, so review Microsoft's licensing terms before use in commercial or redistributed contexts.

Quickstart

pip install azureml-dataprep-rslex
# Then use via azureml-dataprep SDK:
from azureml.dataprep import package_builder
package_builder.use_rust_execution(True)

This package is not intended for direct usage—it is a backend dependency of azureml-dataprep. Install and enable it through the Data Prep SDK, not standalone.

Verify before relying

• Exact performance improvement over the default Data Prep execution engine is not documented in the fact sheet.
• Compatibility matrix with specific azureml-dataprep versions is not specified.
• Whether use_rust_execution(True) is available in all azureml-dataprep versions remains unclear.

Package facts

Evidence: azureml_dataprep_rslex-2.26.0-cp310-cp310-macosx_10_13_x86_64.whl; azureml_dataprep_rslex-2.26.0-cp310-cp310-manylinux1_x86_64.whl; azureml_dataprep_rslex-2.26.0-cp310-cp310-manylinux2014_aarch64.manylinux_2_17_aarch64.whl; azureml_dataprep_rslex-2.26.0-cp310-cp310-win_amd64.whl; azureml_dataprep_rslex-2.26.0-cp311-cp311-macosx_10_13_x86_64.whl; azureml_dataprep_rslex-2.26.0-cp311-cp311-manylinux1_x86_64.whl; azureml_dataprep_rslex-2.26.0-cp311-cp311-manylinux2014_aarch64.manylinux_2_17_aarch64.whl; azureml_dataprep_rslex-2.26.0-cp311-cp311-win_amd64.whl; azureml_dataprep_rslex-2.26.0-cp312-cp312-macosx_10_13_x86_64.whl; azureml_dataprep_rslex-2.26.0-cp312-cp312-manylinux1_x86_64.whl; azureml_dataprep_rslex-2.26.0-cp312-cp312-manylinux2014_aarch64.manylinux_2_17_aarch64.whl; azureml_dataprep_rslex-2.26.0-cp312-cp312-win_amd64.whl; azureml_dataprep_rslex-2.26.0-cp313-cp313-macosx_10_13_x86_64.whl; azureml_dataprep_rslex-2.26.0-cp313-cp313-manylinux1_x86_64.whl; azureml_dataprep_rslex-2.26.0-cp313-cp313-manylinux2014_aarch64.manylinux_2_17_aarch64.whl; azureml_dataprep_rslex-2.26.0-cp313-cp313-win_amd64.whl

Tags

More Scientific/Engineering packages