llama-index-llms-vertex

What it is and what it does

This package provides a connector that lets you use Google Vertex AI language models within LlamaIndex applications. It bridges the LlamaIndex framework and Vertex AI's managed LLM service, allowing you to swap Vertex models into any LlamaIndex component that accepts an LLM.

The package depends on google-cloud-aiplatform for Vertex access and llama-index-core for the integration framework. It requires Python 3.10 or later. The package's own documentation notes that Gemini has largely been replaced by Google GenAI, suggesting this integration may be in transition.

Use it for:

• Build LlamaIndex applications using Google Vertex AI models as the LLM provider.
• Integrate Vertex AI's managed LLM endpoints into existing LlamaIndex workflows.
• Use Vertex models for production LLM applications with Google Cloud infrastructure integration.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

Integrates Google Vertex AI's LLM capabilities with LlamaIndex, enabling use of Vertex models within LlamaIndex applications.

Yes, if you are already using LlamaIndex and need Vertex AI model access. The low install friction and active maintenance make it straightforward to add. However, verify whether Google GenAI integration better suits your use case, as the package documentation suggests Gemini has moved to that path.

Install

llama-index-llms-vertex on PyPI

pip install llama-index-llms-vertex

uv add llama-index-llms-vertex

poetry add llama-index-llms-vertex

Installing llama-index-llms-vertex

Before you install

Low install friction with only two runtime dependencies. Active maintenance status.

License in practice

MIT license permits commercial and private use with minimal restrictions.

Quickstart

pip install llama-index-llms-vertex

from llama_index.llms.vertex import Vertex
llm = Vertex()

Requires Python 3.10 or later and valid Google Cloud credentials configured for Vertex AI access.

Verify before relying

• Whether Vertex AI models are actively maintained or if migration to Google GenAI is recommended for new projects
• Specific Vertex AI model versions and capabilities supported by this integration
• Whether the package's transition away from Gemini affects current or future usability

Package facts

Evidence: llama_index_llms_vertex-0.7.0-py3-none-any.whl

Tags

More Artificial Intelligence packages

Further reading