{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/3"}],"enrichment":{"capability":"Grain is a Python library for reading, transforming, and batching data for training and evaluating machine learning models, with support for declarative data processing pipelines.","skillfed_tags":["data-pipeline","machine-learning","jax"],"use_cases":["Define reproducible data pipelines for training JAX models with shuffling, mapping, and batching in a single declarative chain.","Prepare and transform large datasets for machine learning experiments with deterministic, composable operations.","Load and preprocess data for multi-framework ML workflows without being tied to a specific training framework.","Build data augmentation and transformation steps that integrate seamlessly into ML training loops."],"what_it_does":"Grain is a data loading and transformation library designed for machine learning workflows. It provides a declarative API to define data processing pipelines\u2014shuffling, mapping, batching, and other transformations\u2014in a composable, deterministic way. While built with JAX models in mind, it does not require JAX and can work with other frameworks.\n\nThe library depends on absl-py, array-record, cloudpickle, etils, numpy, portpicker, and protobuf. It is actively maintained by Google, used in projects like MaxText and Gemma, and supports modern Python versions (3.11\u20133.14) across Linux, macOS, and Windows platforms.","worth_installing":"Yes. Grain is production-stable (Development Status 5), actively maintained, permissively licensed, and has no known vulnerabilities. Install friction is moderate but manageable. It is a good fit if you need declarative, deterministic data pipelines for ML training, especially with JAX, but also works with other frameworks."},"id":"grain","links":{"html":"https://skillfed.io/packages/grain","md":"https://skillfed.io/packages/grain.md","pypi":"https://pypi.org/project/grain/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-06-17","license_spdx":null,"license_treatment":"permissive","name":"grain","python_support":"supports_current","summary":"Grain: A library for loading and transforming data for ML training."},"popularity":{"monthly_downloads":2127414,"position":3270,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"0.2.18"}