{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/3"}],"enrichment":{"capability":"Truss is a CLI tool for packaging ML models with their serving logic and deploying them to production, handling containerization, dependency management, and GPU configuration automatically.","skillfed_tags":["model-deployment","mlops","containerization"],"use_cases":["Deploy a Hugging Face transformer model to a production API endpoint with GPU acceleration and automatic scaling","Package a custom PyTorch or TensorFlow model with preprocessing logic and serve it via an OpenAI-compatible interface","Iterate rapidly on model serving config (quantization, sequence length, hardware) with live reload during development","Manage model dependencies and weights in a single reproducible package that works identically in dev and production","Optimize inference performance using TensorRT-LLM compilation for large language models without manual container setup"],"what_it_does":"Truss is a deployment-focused CLI that bridges the gap between local model development and production serving. It wraps your model code, weights, and dependencies into a containerized service that behaves consistently across development and production environments. The tool abstracts away Docker, Kubernetes, and infrastructure configuration\u2014you write a YAML config specifying the model source, hardware (GPU type), and serving engine, then push to deploy.\n\nThe package integrates with Baseten's inference stack and supports multiple serving frameworks including vLLM, SGLang, TensorRT-LLM, transformers, diffusers, PyTorch, and TensorFlow. It handles GPU allocation, secrets management, caching, and autoscaling when deployed to Baseten or compatible infrastructure. The live-reload feature lets you iterate on config changes without full rebuilds, and deployed models expose OpenAI-compatible REST APIs by default.","worth_installing":"Yes. Truss is actively maintained, has no known vulnerabilities, and low install friction. It's worth installing if you need to deploy ML models to production and want to skip Docker/Kubernetes boilerplate. Best suited for teams using Baseten or those comfortable with containerized deployments; verify first whether your target infrastructure is supported."},"id":"truss","links":{"html":"https://skillfed.io/packages/truss","md":"https://skillfed.io/packages/truss.md","pypi":"https://pypi.org/project/truss/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-03","license_spdx":"MIT","license_treatment":"permissive","name":"truss","python_support":"supports_current","summary":"A seamless bridge from model development to model delivery"},"popularity":{"monthly_downloads":1327555,"position":4052,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"0.18.25"}