{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/11"}],"enrichment":{"capability":"Integrates LiteLLM with LlamaIndex to provide unified access to multiple LLM providers (OpenAI, Cohere, and others) through a single interface.","skillfed_tags":["llm-integration","multi-provider","rag"],"use_cases":["Build a RAG pipeline that can swap between OpenAI and Cohere without changing application code.","Prototype LLM features against multiple providers to compare cost, latency, or output quality.","Run LlamaIndex agents that fall back to alternative providers if one API is unavailable.","Implement multi-provider chat applications where users can select their preferred LLM backend.","Stream LLM responses in a LlamaIndex application without rewriting for each provider's API."],"what_it_does":"This package bridges LiteLLM and LlamaIndex, allowing you to use multiple LLM providers through LlamaIndex's standardized interface. Instead of writing provider-specific code for OpenAI, Cohere, or other services, you instantiate a single LiteLLM object with a model identifier and call the same methods\u2014chat, complete, stream_chat, stream_complete, and async variants\u2014regardless of which backend you're targeting.\n\nThe integration handles the translation between LlamaIndex's message and response formats and LiteLLM's provider abstractions. You set API keys as environment variables and switch providers by changing the model string passed to the LiteLLM constructor. It supports both synchronous and asynchronous calls, as well as streaming responses.","worth_installing":"Yes, if you are building with LlamaIndex and need to support multiple LLM providers without provider-specific code. The low install friction, permissive license, active maintenance status, and lack of known vulnerabilities make it a straightforward choice. Install only if you actually need multi-provider flexibility; single-provider projects may not benefit."},"id":"llama-index-llms-litellm","links":{"html":"https://skillfed.io/packages/llama-index-llms-litellm","md":"https://skillfed.io/packages/llama-index-llms-litellm.md","pypi":"https://pypi.org/project/llama-index-llms-litellm/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-03-20","license_spdx":"MIT","license_treatment":"permissive","name":"llama-index-llms-litellm","python_support":"supports_current","summary":"llama-index llms litellm integration"},"popularity":{"monthly_downloads":81251,"position":14240,"tier":"top_15000"},"security":{"n_vulnerabilities":0},"version":"0.7.1"}