opentelemetry-util-genai
OpenTelemetry GenAI Utils
Decision gist · record as of 2026-08-14
Yes, if you are building observability into a GenAI application and want to follow OpenTelemetry standards. The package is actively maintained, has no known vulnerabilities, and low install friction. It is in beta status (1.0b0), so expect the API to stabilize; verify compatibility with your specific GenAI providers and exporters before production use.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.10 or later.
- OpenTelemetry API and instrumentation packages must be installed and configured with appropriate exporters for telemetry to be collected.
- Low install friction with four lightweight runtime dependencies (opentelemetry-api, opentelemetry-instrumentation, opentelemetry-semantic-conventions, wrapt).
License · maintenance · safety
Apache-2.0 (permissive) — Licensed under Apache-2.0 (permissive), allowing commercial and private use with minimal restrictions.
last release 2026-07-09 (36 days) · last repo commit 2026-08-14 · 1,086 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 5,541,228 downloads/mo, #2,079 on PyPI
Alternatives
Verify before relying
pip install opentelemetry-util-genai
from opentelemetry.util.genai.handler import TelemetryHandler
from opentelemetry.util.genai.types import InferenceInvocation
handler = TelemetryHandler()
with handler.chat():
# Your LLM invocation here
pass- Whether the package works with all major GenAI providers or only specific ones (OpenAI shown in examples).
- Performance overhead of telemetry collection at scale.
- Compatibility with custom OpenTelemetry exporters beyond the standard setup.
What it is and what it does
OpenTelemetry Util for GenAI is a standardization layer for instrumenting generative AI libraries. It wraps LLM and embedding invocations to automatically generate spans, metrics, and events following OpenTelemetry semantic conventions. The package provides a TelemetryHandler that manages the lifecycle of AI operations, capturing request parameters, response metadata, token usage, and optionally message content (controlled via environment variables). It also supports uploading prompts and completions to external storage via fsspec-compatible paths.
The package is designed to reduce boilerplate when adding observability to GenAI applications. Instead of manually creating spans and recording metrics for each LLM call, developers use context managers or manual lifecycle methods provided by TelemetryHandler. It sets standard span attributes (operation name, provider, model, server details, token counts) and supports both chat and embedding operations. Message content capture is opt-in and configurable, and event emission can be controlled independently.
Use it for
- Add observability to applications calling OpenAI, Anthropic, or other LLM providers without writing custom instrumentation code.
- Track token usage and latency across LLM invocations for cost monitoring and performance analysis.
- Archive prompts and completions to cloud storage (GCS, S3, local filesystem) for audit, fine-tuning, or debugging.
- Emit structured events with message content to a LoggerProvider for downstream processing or analysis.
- Standardize telemetry across multiple GenAI libraries using OpenTelemetry semantic conventions.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are building observability into a GenAI application and want to follow OpenTelemetry standards.
The package is actively maintained, has no known vulnerabilities, and low install friction. It is in beta status (1.0b0), so expect the API to stabilize; verify compatibility with your specific GenAI providers and exporters before production use.
Install
opentelemetry-util-genai on PyPI
Before you install
Low install friction with four lightweight runtime dependencies (opentelemetry-api, opentelemetry-instrumentation, opentelemetry-semantic-conventions, wrapt). Package is actively maintained with recent commits and is in beta status.
Requires Python 3.10 or later. OpenTelemetry API and instrumentation packages must be installed and configured with appropriate exporters for telemetry to be collected.
License in practice
Licensed under Apache-2.0 (permissive), allowing commercial and private use with minimal restrictions.
Quickstart
pip install opentelemetry-util-genai
from opentelemetry.util.genai.handler import TelemetryHandler
from opentelemetry.util.genai.types import InferenceInvocation
handler = TelemetryHandler()
with handler.chat():
# Your LLM invocation here
passVerify before relying
- Whether the package works with all major GenAI providers or only specific ones (OpenAI shown in examples).
- Performance overhead of telemetry collection at scale.
- Compatibility with custom OpenTelemetry exporters beyond the standard setup.
Package facts
| License | Apache-2.0 permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 4 packagesopentelemetry-apiopentelemetry-instrumentationopentelemetry-semantic-conventionswrapt |
| Maintenance | Actively maintained 36 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 5,541,228 / month, #2,079 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaIntended Audience :: DevelopersLicense :: OSI Approved :: Apache Software LicenseProgramming Language :: PythonProgramming Language :: Python :: 3Programming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14 |
Evidence: opentelemetry_util_genai-1.0b0-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “ai model telemetry handler”
- opentelemetry-util-genaiProvides standardized instrumentation utilities for generative AI…
- loongsuite-util-genaiExtends OpenTelemetry's GenAI semantic conventions to capture…
- opentelemetry-instrumentation-agnoAutomatically instruments the Agno framework to emit OpenTelemetry…
Give your agent the search over MCP, or paste the wish link into any chat.
More Monitoring packages
Wraps any iterable to display a real-time progress bar in the terminal or Jupyter notebook, showing iteration count, elapsed time, and estimated time remaining.
Provides generated Python code for OpenTelemetry semantic conventions, enabling standardized attribute naming and constant definitions for instrumentation and telemetry collection.
Install it if you are using OpenTelemetry and want to follow semantic conventions correctly.
Provides the reference implementation of the OpenTelemetry API for collecting and exporting traces, metrics, and logs from Python applications.
Provides the abstract API and interfaces for OpenTelemetry instrumentation in Python, defining how to emit traces, metrics, and logs without tying code to a specific SDK implementation.
Exports OpenTelemetry observability data to an OpenTelemetry Collector using Protobuf-encoded messages over HTTP.
Install it if you are using OpenTelemetry in Python and need to send data to a Collector over HTTP.
Provides automatic instrumentation commands and programmatic APIs to inject distributed tracing into Python applications without code changes, detecting and instrumenting packages used by your program.
Install it if you need distributed tracing without code changes and have compatible instrumented packages in your environment.
See also loongsuite-util-genai · opentelemetry-instrumentation-google-genai · opentelemetry-instrumentation-openai-v2 · opentelemetry-semantic-conventions-ai · opentelemetry-instrumentation-voyageai · opentelemetry-instrumentation-google-generativeai · genagent · opentelemetry-instrumentation-openai · opentelemetry-instrumentation-litellm · opentelemetry-instrumentation-openai-agents