{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/8"}],"enrichment":{"capability":"Provides a Python client to query text generation models hosted on Hugging Face Inference Endpoints or the Hugging Face Hub, with support for both synchronous and asynchronous generation and token streaming.","skillfed_tags":["llm-client","hugging-face","async-support"],"use_cases":["Query a deployed Hugging Face Inference Endpoint model from Python without managing the underlying HTTP protocol.","Stream text generation tokens in real time for interactive applications or live UI updates.","Build async-first applications that query multiple models concurrently without blocking.","Prototype language model applications against Hugging Face's managed inference without running local infrastructure.","Access generation metadata (finish reason, token logprobs, top-k alternatives) for analysis or debugging."],"what_it_does":"Text Generation is a Python client library for querying large language models hosted on Hugging Face's managed inference infrastructure. It wraps HTTP calls to text-generation-inference instances running on Hugging Face Inference Endpoints or the Hub, exposing both synchronous and asynchronous interfaces for generating text completions. The library handles request serialization via pydantic, HTTP communication through aiohttp, and model discovery via huggingface-hub.\n\nYou use it by instantiating a Client (or AsyncClient) with an endpoint URL, then calling generate() or generate_stream() to send prompts and receive completions. The library supports advanced generation parameters\u2014sampling, repetition penalties, stop sequences, grammar constraints, and token-level details\u2014and can stream tokens as they are produced rather than waiting for the full response.","worth_installing":"No\u2014do not install. The package is abandoned (archived repository, no commits since 2026-03-21), carries four known vulnerabilities, and receives no maintenance. While the install friction is low and the license is permissive, the lack of security patches and active support makes it unsuitable for production use. Consider using the official Hugging Face Hub library or InferenceClient from huggingface-hub directly instead."},"id":"text-generation","links":{"html":"https://skillfed.io/packages/text-generation","md":"https://skillfed.io/packages/text-generation.md","pypi":"https://pypi.org/project/text-generation/"},"maintenance":{"status":"abandoned"},"meta":{"latest_release":"2024-03-22","license_spdx":null,"license_treatment":"permissive","name":"text-generation","python_support":"supports_current","summary":"Hugging Face Text Generation Python Client"},"popularity":{"monthly_downloads":173500,"position":10306,"tier":"top_15000"},"security":{"n_vulnerabilities":4},"version":"0.7.0"}
