{"categories":[{"label":"Python Modules","url":"https://skillfed.io/packages/category/software-development-libraries-python-modules/19"},{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/9"}],"enrichment":{"capability":"openvino-genai simplifies running inference on generative AI models by wrapping OpenVINO's inference engine with a high-level pipeline API that handles tokenization, model loading, and text generation.","skillfed_tags":["llm-inference","edge-deployment","model-optimization"],"use_cases":["Run a local chat interface or Q&A system using a converted LLM without cloud dependencies.","Integrate text generation into a Python application with minimal setup overhead.","Experiment with different beam search and generation parameters on a single machine.","Deploy generative AI inference on edge devices or servers with Intel hardware acceleration."],"what_it_does":"openvino-genai is a Python library that wraps OpenVINO's inference runtime to simplify running generative AI models locally. It provides a high-level LLMPipeline class that automatically loads tokenizers, detokenizers, and generation configs from a model directory, reducing boilerplate code to a few lines. The library handles the complexity of the generation process\u2014including beam search, streaming output, and custom generation parameters\u2014while targeting CPU and hardware accelerators through OpenVINO's backend.\n\nThe package is designed for developers who want to run language models without managing low-level inference details. It depends on openvino_tokenizers for tokenization and requires models to be pre-converted to OpenVINO IR format. Version alignment between openvino-genai and its dependencies is critical; mismatched versions can cause ABI incompatibility errors. The library supports both Python and C++ interfaces, though the Python API is the primary entry point for most users.","worth_installing":"Yes, if you need to run generative AI models locally and are willing to pre-convert models to OpenVINO IR format. The library significantly reduces boilerplate compared to raw OpenVINO, and active maintenance plus Apache 2.0 licensing make it low-risk. The main gotcha is strict version pinning of openvino_tokenizers; verify compatibility before updating dependencies. Not recommended if you need out-of-the-box support for Hugging Face model formats or if you prefer cloud-based inference."},"id":"openvino-genai","links":{"html":"https://skillfed.io/packages/openvino-genai","md":"https://skillfed.io/packages/openvino-genai.md","pypi":"https://pypi.org/project/openvino-genai/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-04","license_spdx":null,"license_treatment":"permissive","name":"openvino-genai","python_support":"supports_current","summary":"Library of the most popular Generative AI model pipelines, optimized execution methods, and samples"},"popularity":{"monthly_downloads":115968,"position":12226,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"2026.3.0.0"}