{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/4"}],"enrichment":{"capability":"Cache-DiT accelerates inference for Diffusion Transformers (DiTs) via hybrid caching, parallelism, quantization, and CPU offloading, integrating with the Diffusers library and supporting NVIDIA, AMD, and Ascend hardware.","skillfed_tags":["diffusion-inference","gpu-optimization","quantization"],"use_cases":["Speed up text-to-image generation pipelines by enabling KV-cache and context parallelism with minimal code changes.","Reduce GPU memory footprint and latency on multi-GPU setups using tensor parallelism and hybrid 2D/3D parallelism.","Quantize large DiT models to int4 or nvfp4 precision without calibration data using SVDQuant.","Offload transformer layers to CPU during inference to fit larger models on limited GPU VRAM.","Integrate cache acceleration into existing ComfyUI, SGLang, or vLLM workflows via community plugins."],"what_it_does":"Cache-DiT is a PyTorch inference engine for Diffusion Transformers that wraps the Diffusers library and applies multiple optimization strategies: KV-cache acceleration (DBCache, TaylorSeer, SCM), multi-GPU parallelism (Context, Tensor, 2D/3D hybrid), quantization (including SVDQuant W4A4), and layerwise CPU offloading. It integrates with SGLang Diffusion, vLLM-Omni, TensorRT-LLM, ComfyUI, and other frameworks.\n\nThe package is designed to be easy to adopt: a single `cache_dit.enable_cache(pipe)` call on a Diffusers pipeline activates caching, and optional config objects allow fine-grained control over parallelism and quantization. It runs on NVIDIA, AMD, and Ascend GPUs. The library is actively maintained, has no known vulnerabilities, and depends on standard ML packages (torch, diffusers, transformers, pyyaml, packaging).","worth_installing":"Yes, with conditions. Cache-DiT is actively maintained, has no known vulnerabilities, and offers genuine performance gains for Diffusion Transformer inference. Install it if you run Diffusers pipelines on GPU and want to reduce latency or memory usage. However, verify the license status before use in proprietary contexts, and test speedup claims on your specific hardware and model architecture."},"id":"cache-dit","links":{"html":"https://skillfed.io/packages/cache-dit","md":"https://skillfed.io/packages/cache-dit.md","pypi":"https://pypi.org/project/cache-dit/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-06-16","license_spdx":null,"license_treatment":"unclear","name":"cache-dit","python_support":"supports_current","summary":"Cache-DiT: A PyTorch-native Inference Engine with Cache, Parallelism, Quantization and CPU Offload for DiTs."},"popularity":{"monthly_downloads":646072,"position":5596,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.5.0"}