{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/8"}],"enrichment":{"capability":"Provides inference components and utilities for generative AI applications, including model invocation, data processing, and integration with LLM frameworks.","skillfed_tags":["llm-inference","generative-ai","async-http"],"use_cases":["Building inference pipelines that invoke language models within larger Gen AI applications.","Integrating LLM inference with data processing workflows using pandas and numpy.","Handling multimodal inputs (audio, video, text) in inference scenarios via av and sounddevice.","Constructing async inference services using aiohttp and aiofiles for concurrent request handling."],"what_it_does":"GLLM Inference is a library for building generative AI inference components. It bundles a large set of dependencies\u2014including langchain, numpy, pandas, aiohttp, and audio/video processing libraries\u2014to support model invocation, data handling, and integration in Gen AI applications. The package is distributed as a binary wheel on PyPI, meaning the compiled code is included but source code is not.\n\nThe library targets Python 3.11 and later and is actively maintained. It has 21 runtime dependencies, which provides broad capability but also increases install complexity and potential compatibility surface. Installation from PyPI is straightforward; alternative installation from an internal Artifact Registry requires gcloud authentication.","worth_installing":"Yes, if you are building Gen AI inference components and can accept the license ambiguity and 21-dependency footprint. The package is actively maintained, has no known vulnerabilities, and covers a broad inference use case. However, verify the license terms first and confirm that the binary-only distribution meets your source-code requirements."},"id":"gllm-inference-binary","links":{"html":"https://skillfed.io/packages/gllm-inference-binary","md":"https://skillfed.io/packages/gllm-inference-binary.md","pypi":"https://pypi.org/project/gllm-inference-binary/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-14","license_spdx":null,"license_treatment":"unclear","name":"gllm-inference-binary","python_support":"supports_current","summary":"A library containing components related to model inferences in Gen AI applications."},"popularity":{"monthly_downloads":148343,"position":11038,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.6.116"}