{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/6"}],"enrichment":{"capability":"Provides a model serving stack for deploying machine learning models in Docker containers on Amazon SageMaker, built on Multi Model Server.","skillfed_tags":["sagemaker","model-serving","docker"],"use_cases":["Build a custom Docker inference container for a PyTorch or TensorFlow model to deploy on SageMaker.","Implement multi-model serving where a single container handles multiple model versions or types.","Add standardized input/output handling (JSON, CSV, NPZ) to a model serving pipeline.","Create a handler service that integrates with SageMaker's model server lifecycle (initialization and request handling)."],"what_it_does":"SageMaker Inference Toolkit is a library that packages a model serving stack for deployment on Amazon SageMaker. It abstracts the complexity of setting up inference endpoints by providing handler interfaces for model loading, input preprocessing, prediction, and output serialization. The toolkit is designed to be embedded in Docker containers and works with Multi Model Server to handle incoming inference requests.\n\nThe library is intended for developers building custom inference containers for SageMaker. It provides base classes and utilities (decoder, encoder, content type handlers) that you extend to define how your specific model should be loaded and served. However, the repository has been archived and is no longer actively maintained as of late 2023, which means it may not receive updates for compatibility with newer Python versions or SageMaker features.","worth_installing":"Yes, but with caution. Install if you are actively deploying models to Amazon SageMaker and need a structured framework for containerized inference. The permissive Apache 2.0 license poses no barrier. However, the abandoned repository status (last commit 2023-11-20) means you should verify compatibility with your target SageMaker version and Python runtime before committing to production use. If you are starting a new project, check whether SageMaker's prebuilt containers or newer alternatives better suit your needs."},"id":"sagemaker-inference","links":{"html":"https://skillfed.io/packages/sagemaker-inference","md":"https://skillfed.io/packages/sagemaker-inference.md","pypi":"https://pypi.org/project/sagemaker-inference/"},"maintenance":{"status":"abandoned"},"meta":{"latest_release":"2023-10-25","license_spdx":null,"license_treatment":"permissive","name":"sagemaker-inference","python_support":"unspecified","summary":"Open source toolkit for helping create serving containers to run on Amazon SageMaker."},"popularity":{"monthly_downloads":315403,"position":7687,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"1.10.1"}