{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/4"}],"enrichment":{"capability":"NNCF provides post-training and training-time compression algorithms for neural networks, optimizing inference in OpenVINO, PyTorch, TorchFX, and ONNX with minimal accuracy loss.","skillfed_tags":["model-optimization","quantization","edge-inference"],"use_cases":["Quantize large language models (e.g., Llama) to INT4 weights for efficient OpenVINO deployment via HuggingFace Optimum.","Apply post-training quantization to ONNX models without retraining to reduce inference latency.","Fine-tune PyTorch models with quantization-aware training to maintain accuracy while reducing model size.","Prune and sparsify neural networks during training to accelerate inference on edge devices.","Export PyTorch models to OpenVINO format with INT4-quantized weights for production deployment.","Integrate compression into custom training pipelines via the unified NNCF API and Git patch examples."],"what_it_does":"NNCF is a framework for compressing neural networks to reduce inference latency and model size. It implements post-training algorithms (quantization, weight compression, activation sparsity) and training-time methods (quantization-aware training, pruning, weight-only quantization with LoRA). The framework works with PyTorch, TorchFX, ONNX, and OpenVINO models, offering a unified Python API for model graph transformation and compression.\n\nThe package is designed for practitioners who need to optimize models for deployment on resource-constrained devices or edge hardware. It integrates into third-party ecosystems including HuggingFace Optimum Intel, Ultralytics, ExecuTorch, and torch.compile, making it accessible within existing training and export pipelines. Runtime dependencies include networkx, numpy, scikit-learn, scipy, and visualization tools like pydot and rich.","worth_installing":"Yes. NNCF is actively maintained, has no known vulnerabilities, installs with low friction, and is widely adopted in production ecosystems (HuggingFace, Ultralytics, ExecuTorch, torch.compile). Choose it if you need to compress models for inference optimization across PyTorch, ONNX, or OpenVINO. Requires Python 3.10+; verify backend-specific system requirements for your target framework."},"id":"nncf","links":{"html":"https://skillfed.io/packages/nncf","md":"https://skillfed.io/packages/nncf.md","pypi":"https://pypi.org/project/nncf/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-05","license_spdx":"Apache-2.0","license_treatment":"permissive","name":"nncf","python_support":"supports_current","summary":"Neural Networks Compression Framework"},"popularity":{"monthly_downloads":1297270,"position":4091,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"3.3.0"}
