{"categories":[{"label":"Libraries","url":"https://skillfed.io/packages/category/software-development-libraries/7"}],"enrichment":{"capability":"A Python client library for connecting to and managing Xinference model servers over HTTP, enabling programmatic access to launch, retrieve, and interact with language models.","skillfed_tags":["model-serving","rest-client","language-models"],"use_cases":["Launch and query language models on a remote Xinference server from a Python application without direct model management.","Build chatbot or conversational AI applications that delegate inference to a centralized Xinference deployment.","Integrate model inference into data pipelines or batch processing workflows using a simple client API.","Prototype or test different language models by swapping model names without changing client code.","Monitor and manage model lifecycle (launch, retrieve state) programmatically across multiple applications."],"what_it_does":"xinference-client is a Python HTTP client for the Xinference model serving platform, allowing developers to programmatically launch, retrieve, and query language models running on a Xinference server. It wraps REST API calls into a Python-friendly interface, handling model lifecycle management (launch, get) and inference requests (chat completions with configurable generation parameters).\n\nThe package is built on standard HTTP libraries (requests, aiohttp) and integrates with pydantic for data validation. It's designed for scenarios where models are hosted on a separate Xinference server and accessed remotely, rather than for local model execution. The client abstracts away HTTP details and returns structured responses (chat completion objects with token counts, finish reasons, and assistant messages).","worth_installing":"Yes, if you are running a Xinference server and need a Python client to access it. The package is actively maintained, has low install friction, carries no known vulnerabilities, and uses a permissive license. It is not useful standalone\u2014it requires a running Xinference server to connect to."},"id":"xinference-client","links":{"html":"https://skillfed.io/packages/xinference-client","md":"https://skillfed.io/packages/xinference-client.md","pypi":"https://pypi.org/project/xinference-client/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-31","license_spdx":null,"license_treatment":"permissive","name":"xinference-client","python_support":"unspecified","summary":"Client for Xinference"},"popularity":{"monthly_downloads":204341,"position":9610,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"3.1.0"}