{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/9"}],"enrichment":{"capability":"Compresses and optimizes neural networks through quantization, pruning, and hardware-aware techniques, reducing model size and computational cost for edge deployment.","skillfed_tags":["model-optimization","quantization","edge-deployment"],"use_cases":["Reduce inference latency and memory footprint of trained PyTorch or Keras models for deployment on resource-constrained edge devices.","Perform post-training quantization on existing models without retraining, when representative data is available or can be synthetically generated.","Search for optimal per-layer bit-widths across a model to balance accuracy and compression for a specific hardware target.","Generate synthetic training data from model statistics when real representative data is unavailable, enabling quantization without access to original datasets.","Debug and visualize quantization impact on model layers using TensorBoard and adjust per-layer quantization settings via the network editor.","Prune redundant channels from neural network layers to reduce model complexity and improve hardware utilization."],"what_it_does":"Model Compression Toolkit is a library for reducing the size and computational cost of neural networks through quantization, pruning, and hardware-aware optimization. It supports three main quantization workflows: post-training quantization (PTQ, low computational cost), gradient-based post-training quantization (GPTQ, moderate cost), and quantization-aware training (QAT, high cost). The toolkit takes a pre-trained floating-point model (PyTorch or Keras) and applies compression techniques to produce a smaller, faster model suitable for edge deployment.\n\nThe package includes advanced features like mixed-precision bit-width search per layer, graph optimizations, quantization parameter tuning, data-free synthetic data generation from batch normalization statistics, structured pruning, and hardware-aware optimization via Target Platform Capabilities (TPC). It provides visualization and debugging tools through TensorBoard integration and a network editor for manual quantization configuration. With 14 runtime dependencies covering numerical computing, visualization, and ML frameworks, it integrates into standard ML pipelines.","worth_installing":"Yes. The package is actively maintained, has low install friction, carries a permissive Apache 2.0 license, and addresses a real production need (model compression for edge deployment). It supports both PyTorch and Keras, offers multiple quantization strategies with varying computational costs, and includes practical features like data-free quantization and hardware-aware optimization. Install it if you need to compress trained models for deployment; the main constraint is the Python >=3.10 requirement and the need to provide a pre-trained model as input."},"id":"model-compression-toolkit","links":{"html":"https://skillfed.io/packages/model-compression-toolkit","md":"https://skillfed.io/packages/model-compression-toolkit.md","pypi":"https://pypi.org/project/model-compression-toolkit/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-03-04","license_spdx":null,"license_treatment":"permissive","name":"model-compression-toolkit","python_support":"supports_current","summary":"A Model Compression Toolkit for neural networks"},"popularity":{"monthly_downloads":115244,"position":12262,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"2.6.0"}