{"categories":[{"label":"Utilities","url":"https://skillfed.io/packages/category/utilities/4"}],"enrichment":{"capability":"Internal S3 client implementation providing optimized data loading and checkpoint management for PyTorch training jobs accessing Amazon S3.","skillfed_tags":["pytorch-integration","aws-s3","distributed-training"],"use_cases":["Load training datasets from S3 buckets with automatic optimization for high-throughput data pipelines","Save model checkpoints directly to S3 during training without writing to local disk first","Implement distributed checkpointing across multiple training nodes using PyTorch's distributed checkpoint framework","Stream sequential training data from S3 using iterable-style datasets for memory-efficient training","Access S3 Express One Zone directory buckets for low-latency training data access"],"what_it_does":"s3torchconnectorclient is an internal S3 client implementation that provides optimized access to Amazon S3 for PyTorch training workflows. It supports both map-style datasets for random access and iterable-style datasets for streaming sequential access, handling concurrent S3 requests and bucket listing automatically without requiring custom integration code.\n\nThe package includes checkpoint management interfaces for saving and loading model checkpoints directly to S3 without intermediate local storage. For distributed training, it implements PyTorch's StorageWriter and StorageReader interfaces. It supports Python 3.8 through 3.14 and requires PyTorch 2.0 or newer, with PyTorch 2.3 or newer needed for distributed checkpoint features.","worth_installing":"Yes, if you are training PyTorch models with data in Amazon S3 and want optimized, managed S3 access without writing custom integration code. Install friction is moderate (platform-specific wheels for Linux and macOS only), but maintenance is active and there are no known vulnerabilities. Verify whether you should install this directly or rely on it as a transitive dependency."},"id":"s3torchconnectorclient","links":{"html":"https://skillfed.io/packages/s3torchconnectorclient","md":"https://skillfed.io/packages/s3torchconnectorclient.md","pypi":"https://pypi.org/project/s3torchconnectorclient/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-02-20","license_spdx":null,"license_treatment":"permissive","name":"s3torchconnectorclient","python_support":"supports_current","summary":"Internal S3 client implementation for s3torchconnector"},"popularity":{"monthly_downloads":1405841,"position":3944,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"1.5.0"}