hf-xet
Fast transfer of large files with the Hugging Face Hub.
Install
hf-xet on PyPI
pip
pip install hf-xetuv
uv add hf-xetpoetry
poetry add hf-xetPackage facts
| License | Apache-2.0 (permissive) |
| Python support | supports the current Python release (>=3.8) |
| Install friction | medium — platform-specific wheel |
| Runtime dependencies | none |
| Maintenance | actively maintained — 10 days since the last release |
| Last repo commit | |
| First released | |
| Popularity | one of the top 1,000 most-downloaded packages on PyPI (30-day window, as of 2026-08-13) |
| Known vulnerabilities | none known (OSV.dev, checked 2026-08-13) |
Evidence: hf_xet-1.6.0-cp314-cp314t-macosx_10_12_x86_64.whl; hf_xet-1.6.0-cp314-cp314t-macosx_11_0_arm64.whl; hf_xet-1.6.0-cp314-cp314t-manylinux2014_x86_64.manylinux_2_17_x86_64.whl; hf_xet-1.6.0-cp314-cp314t-manylinux_2_28_aarch64.whl; hf_xet-1.6.0-cp314-cp314t-musllinux_1_2_aarch64.whl; hf_xet-1.6.0-cp314-cp314t-musllinux_1_2_x86_64.whl; hf_xet-1.6.0-cp314-cp314t-win_amd64.whl; hf_xet-1.6.0-cp314-cp314t-win_arm64.whl; hf_xet-1.6.0-cp38-abi3-macosx_10_12_x86_64.whl; hf_xet-1.6.0-cp38-abi3-macosx_11_0_arm64.whl; hf_xet-1.6.0-cp38-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl; hf_xet-1.6.0-cp38-abi3-manylinux_2_28_aarch64.whl; hf_xet-1.6.0-cp38-abi3-musllinux_1_2_aarch64.whl; hf_xet-1.6.0-cp38-abi3-musllinux_1_2_x86_64.whl; hf_xet-1.6.0-cp38-abi3-win_amd64.whl; hf_xet-1.6.0-cp38-abi3-win_arm64.whl
About hf-xet
from the package's own PyPI description — quoted content, verbatim
<!--- Copyright 2024 The HuggingFace Team. All rights reserved.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> <p align="center"> <a href="https://github.com/huggingface/xet-core/blob/main/LICENSE"><img alt="License" src="https://img.shields.io/github/license/huggingface/xet-core.svg?color=blue"></a> <a href="https://github.com/huggingface/xet-core/releases"><img alt="GitHub release" src="https://img.shields.io/github/release/huggingface/xet-core.svg"></a> <a href="https://github.com/huggingface/xet-core/blob/main/CODE_OF_CONDUCT.md"><img alt="Contributor Covenant" src="https://img.shields.io/badge/Contributor%20Covenant-v2.0%20adopted-ff69b4.svg"></a> </p>
<h3 align="center"> <p>🤗 hf-xet -...
Read as markdown · JSON record · Source repository · Homepage · Docs
AI interpretation — verify before relying
AI-generated interpretation of the package facts above; every digit, version, license, or vulnerability id it cites is grounded in the facts already shown on this page
hf-xet provides chunk-based deduplication and efficient storage for large file transfers with local disk caching and Git LFS compatibility. It is a backend library designed for integration with huggingface_hub rather than direct standalone use.
Medium install friction due to compiled wheels across multiple Python versions and platforms (cp38-abi3 through cp314t), but zero runtime dependencies simplifies deployment. Active maintenance with 10-day release cadence and 557 repository stars.
Apache-2.0 permissive license allows commercial and private use with minimal restrictions; users must retain license and copyright notices.
Usage
pip install hf_xet
import hf_xet
Requires Python 3.8 or later; designed for backend integration rather than direct application use.
Verdict: hf-xet is production-stable (Development Status 5), actively maintained with zero security vulnerabilities and no runtime dependencies. Apache-2.0 permissive licensing poses no restrictions. Medium install friction from compiled wheels is typical for performance-critical storage code. Safe to depend on as a backend component.
Needs verification
- Whether medium install friction translates to meaningful delays on typical developer machines or CI/CD pipelines
- Performance characteristics of chunk deduplication relative to direct Git LFS uploads
- Specific use cases where direct hf_xet integration is appropriate versus indirect use through huggingface_hub
Similar packages
permissive · top 100 on PyPI
sentence-transformerspermissive · top 1,000 on PyPI
datasetspermissive · top 1,000 on PyPI
transformerspermissive · top 1,000 on PyPI
acceleratepermissive · top 1,000 on PyPI
pyicebergpermissive · top 1,000 on PyPI
universal-pathlibpermissive · top 1,000 on PyPI
diskcachepermissive · top 1,000 on PyPI
url-normalizepermissive · top 1,000 on PyPI
tokenizerspermissive · top 1,000 on PyPI