{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/3"}],"enrichment":{"capability":"Loads safetensors model files significantly faster than the standard safetensors deserializer by optimizing I/O patterns for GPU and storage systems.","skillfed_tags":["model-loading","performance-optimization","gpu-io"],"use_cases":["Reduce startup time when serving large language models by using fastsafetensors as the model loader.","Speed up model initialization in custom Python code that loads large safetensors files from local or remote storage.","Optimize model loading on AMD ROCm systems or systems with GPU Direct Storage to maximize NVMe throughput.","Integrate into machine learning inference pipelines where model load time is a bottleneck."],"what_it_does":"fastsafetensors is a high-performance loader for safetensors model files, designed to accelerate model initialization in machine learning frameworks. It replaces the default safetensors deserializer with optimized I/O routines that exploit GPU and storage hardware capabilities\u2014including NVIDIA GDS, AMD ROCm, and NVMe\u2014to reduce model loading time. The library integrates into existing tools as a command-line option.\n\nThe package provides both a direct Python API and CLI integration via typer. It supports Linux/CUDA, ROCm, Windows, and specialized storage systems like 3FS and unified-memory architectures. Installation requires a precompiled wheel for your Python version and architecture.","worth_installing":"Yes, if you load large safetensors models and want faster initialization. The package is actively maintained, has no known vulnerabilities, and offers substantial speedups with minimal friction\u2014install and use the API or CLI. Medium install friction is standard for compiled packages with architecture-specific wheels."},"id":"fastsafetensors","links":{"html":"https://skillfed.io/packages/fastsafetensors","md":"https://skillfed.io/packages/fastsafetensors.md","pypi":"https://pypi.org/project/fastsafetensors/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-07","license_spdx":null,"license_treatment":"permissive","name":"fastsafetensors","python_support":"supports_current","summary":"High-performance safetensors model loader"},"popularity":{"monthly_downloads":2095638,"position":3299,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"0.3.3"}