{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/6"}],"enrichment":{"capability":"Accelerates large language model inference on Intel hardware (GPU, NPU, CPU) with low-bit quantization and integration into popular LLM frameworks.","skillfed_tags":["archived-unmaintained","intel-hardware-specific","quantization"],"use_cases":["Run quantized LLMs locally on Intel Arc GPUs without external cloud services","Integrate low-bit quantized models into Ollama or llama.cpp workflows on Intel hardware","Serve LLMs via vLLM with Intel GPU acceleration for batch inference","Fine-tune models using Axolotl with Intel GPU backend","Deploy multimodal models (Qwen-VL, Phi-3-Vision) on Intel NPU or GPU"],"what_it_does":"IPEX-LLM is an acceleration library for running large language models on Intel hardware\u2014GPUs (Arc, Flex, Max), NPUs (Core Ultra), and CPUs. It provides low-bit quantization (FP8, FP6, FP4, INT4) and integrates with popular frameworks like PyTorch, llama.cpp, Ollama, vLLM, LangChain, and HuggingFace transformers to reduce memory footprint and improve inference speed on Intel-based systems.\n\nThe library supports over 70 models including Llama, Phi, Mistral, Qwen, and DeepSeek variants. However, the project is now archived and abandoned\u2014Intel will not provide maintenance, bug fixes, new releases, or support. The description notes known security issues exist. Users should treat this as a snapshot tool rather than an actively maintained dependency.","worth_installing":"No. The project is archived and abandoned; Intel provides no maintenance, bug fixes, or support. Known security issues are documented and will not be patched. While the library may still function, adopting an unmaintained LLM acceleration tool introduces technical debt and security risk. Consider maintained alternatives or direct integration with actively supported frameworks."},"id":"ipex-llm","links":{"html":"https://skillfed.io/packages/ipex-llm","md":"https://skillfed.io/packages/ipex-llm.md","pypi":"https://pypi.org/project/ipex-llm/"},"maintenance":{"status":"abandoned"},"meta":{"latest_release":"2025-04-07","license_spdx":null,"license_treatment":"permissive","name":"ipex-llm","python_support":"unspecified","summary":"Large Language Model Develop Toolkit"},"popularity":{"monthly_downloads":322364,"position":7612,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"2.2.0"}