skillfed

hf-xet

Fast transfer of large files with the Hugging Face Hub.

hf-xet Permissive license Apache-2.0 Active 557 v1.6.0 released

Install

hf-xet on PyPI

pip

pip install hf-xet

uv

uv add hf-xet

poetry

poetry add hf-xet

Package facts

License Apache-2.0 (permissive)
Python support supports the current Python release (>=3.8)
Install friction medium — platform-specific wheel
Runtime dependencies none
Maintenance actively maintained — 10 days since the last release
Last repo commit
First released
Popularity one of the top 1,000 most-downloaded packages on PyPI (30-day window, as of 2026-08-13)
Known vulnerabilities none known (OSV.dev, checked 2026-08-13)

Evidence: hf_xet-1.6.0-cp314-cp314t-macosx_10_12_x86_64.whl; hf_xet-1.6.0-cp314-cp314t-macosx_11_0_arm64.whl; hf_xet-1.6.0-cp314-cp314t-manylinux2014_x86_64.manylinux_2_17_x86_64.whl; hf_xet-1.6.0-cp314-cp314t-manylinux_2_28_aarch64.whl; hf_xet-1.6.0-cp314-cp314t-musllinux_1_2_aarch64.whl; hf_xet-1.6.0-cp314-cp314t-musllinux_1_2_x86_64.whl; hf_xet-1.6.0-cp314-cp314t-win_amd64.whl; hf_xet-1.6.0-cp314-cp314t-win_arm64.whl; hf_xet-1.6.0-cp38-abi3-macosx_10_12_x86_64.whl; hf_xet-1.6.0-cp38-abi3-macosx_11_0_arm64.whl; hf_xet-1.6.0-cp38-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl; hf_xet-1.6.0-cp38-abi3-manylinux_2_28_aarch64.whl; hf_xet-1.6.0-cp38-abi3-musllinux_1_2_aarch64.whl; hf_xet-1.6.0-cp38-abi3-musllinux_1_2_x86_64.whl; hf_xet-1.6.0-cp38-abi3-win_amd64.whl; hf_xet-1.6.0-cp38-abi3-win_arm64.whl

Development Status :: 5 - Production/StableLicense :: OSI Approved :: Apache Software LicenseProgramming Language :: Python :: 3Programming Language :: Python :: 3 :: OnlyProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Programming Language :: Python :: 3.8Programming Language :: Python :: 3.9Programming Language :: Python :: Free ThreadingProgramming Language :: Python :: Free Threading :: 2 - BetaProgramming Language :: Python :: Implementation :: CPythonProgramming Language :: Python :: Implementation :: PyPyProgramming Language :: RustTopic :: Scientific/Engineering :: Artificial Intelligence

About hf-xet

from the package's own PyPI description — quoted content, verbatim

<!--- Copyright 2024 The HuggingFace Team. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> <p align="center"> <a href="https://github.com/huggingface/xet-core/blob/main/LICENSE"><img alt="License" src="https://img.shields.io/github/license/huggingface/xet-core.svg?color=blue"></a> <a href="https://github.com/huggingface/xet-core/releases"><img alt="GitHub release" src="https://img.shields.io/github/release/huggingface/xet-core.svg"></a> <a href="https://github.com/huggingface/xet-core/blob/main/CODE_OF_CONDUCT.md"><img alt="Contributor Covenant" src="https://img.shields.io/badge/Contributor%20Covenant-v2.0%20adopted-ff69b4.svg"></a> </p>

<h3 align="center"> <p>🤗 hf-xet -...

Read as markdown · JSON record · Source repository · Homepage · Docs

AI interpretation — verify before relying

AI-generated interpretation of the package facts above; every digit, version, license, or vulnerability id it cites is grounded in the facts already shown on this page

hf-xet provides chunk-based deduplication and efficient storage for large file transfers with local disk caching and Git LFS compatibility. It is a backend library designed for integration with huggingface_hub rather than direct standalone use.

Medium install friction due to compiled wheels across multiple Python versions and platforms (cp38-abi3 through cp314t), but zero runtime dependencies simplifies deployment. Active maintenance with 10-day release cadence and 557 repository stars.

Apache-2.0 permissive license allows commercial and private use with minimal restrictions; users must retain license and copyright notices.

Usage

pip install hf_xet

import hf_xet

Requires Python 3.8 or later; designed for backend integration rather than direct application use.

Verdict: hf-xet is production-stable (Development Status 5), actively maintained with zero security vulnerabilities and no runtime dependencies. Apache-2.0 permissive licensing poses no restrictions. Medium install friction from compiled wheels is typical for performance-critical storage code. Safe to depend on as a backend component.

Needs verification

  • Whether medium install friction translates to meaningful delays on typical developer machines or CI/CD pipelines
  • Performance characteristics of chunk deduplication relative to direct Git LFS uploads
  • Specific use cases where direct hf_xet integration is appropriate versus indirect use through huggingface_hub
hugging face hub file transferchunk deduplication storagelarge file upload downloadxet storage clientgit lfs compatibledisk cache managementefficient binary file storage

Similar packages