{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/2"}],"enrichment":{"capability":"Opik is an open-source LLM observability and evaluation platform that logs traces of LLM calls, agents, and pipelines, then evaluates them with datasets, experiments, and LLM-as-a-judge metrics.","skillfed_tags":["llm-observability","agent-tracing","evaluation-framework"],"use_cases":["Log and inspect full execution traces of multi-step agents and LLM pipelines during development and in production.","Evaluate LLM outputs for hallucinations, factual accuracy, and moderation using LLM-as-a-judge metrics.","Test RAG systems by measuring answer relevance and context precision across datasets and experiments.","Integrate LLM evaluation into CI/CD pipelines using pytest to validate prompts and models on every commit.","Monitor production LLM applications by tracking trace counts, token usage, and feedback scores over time.","Manage and version prompts, then experiment with different models and parameters in a shared playground."],"what_it_does":"Opik is a Python SDK and full-stack platform for observing, evaluating, and optimizing LLM applications and AI agents. It wraps functions with a `@track` decorator to automatically log traces of LLM calls, nested function calls, and agent activity, capturing full execution trees for multi-step workflows. The platform includes evaluation tools\u2014datasets, experiments, and LLM-as-a-judge metrics\u2014for testing hallucinations, moderation, and RAG quality. It also provides prompt management, a playground for experimentation, CI/CD integration via pytest, and production dashboards for monitoring feedback scores and token usage.\n\nThe package is built by Comet and released under Apache 2.0, meaning you can self-host the entire backend in your own infrastructure. It supports modern Python versions (3.10\u20133.14) and integrates with popular LLM frameworks. The SDK depends on litellm, openai, pydantic, httpx, and other standard libraries for tracing, configuration, and API communication.","worth_installing":"Yes. Opik is actively maintained with no known vulnerabilities and offers low install friction. It is genuinely open-source (Apache 2.0) with a self-hostable full platform, not just a client SDK. If you are building LLM agents or need observability and evaluation for LLM applications, this is a solid choice\u2014especially if you want to avoid vendor lock-in or need to keep traces within your own infrastructure."},"id":"opik","links":{"html":"https://skillfed.io/packages/opik","md":"https://skillfed.io/packages/opik.md","pypi":"https://pypi.org/project/opik/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-08-14","license_spdx":null,"license_treatment":"permissive","name":"opik","python_support":"supports_current","summary":"Comet tool for logging and evaluating LLM traces"},"popularity":{"monthly_downloads":3695539,"position":2523,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"2.2.29"}