verifiers
Verifiers: Environments for LLM Reinforcement Learning
Decision gist · record as of 2026-08-14
Yes, if you are training or evaluating LLMs with reinforcement learning and plan to use the Prime ecosystem. The package is actively maintained, has no known vulnerabilities, and integrates tightly with prime-rl and Hosted Training. If you need a standalone environment harness without Prime integration, verify that the 26 dependencies and ecosystem lock-in align with your workflow first.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.11 or later.
- The package is tightly integrated with Prime CLI and the Environments Hub; standalone use may require additional setup.
- Low friction installation with a pure-Python wheel.
License · maintenance · safety
MIT (permissive) — MIT license (permissive). No restrictions on commercial or private use; you may modify and redistribute under the same license.
last release 2026-08-07 (7 days) · last repo commit 2026-08-14 · 4,513 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 554,110 downloads/mo, #6,037 on PyPI
Alternatives
Verify before relying
pip install verifiers
from verifiers import Environment
env = Environment()- Specific API surface and core classes beyond Environment—documentation depth unclear from excerpt.
- Whether 26 runtime dependencies are all required or some are optional/conditional.
- Integration requirements with prime-rl and Hosted Training platform for full functionality.
What it is and what it does
Verifiers is a library for creating and managing training and evaluation environments for large language models, built around reinforcement learning workflows. It is designed to work within the Prime ecosystem—specifically the Environments Hub, the prime-rl training framework, and the Hosted Training platform—but can also be used as a standalone harness for multi-turn agent interactions, tool-use training, and LLM verification tasks.
The package brings together environment management, evaluation harnesses, and agent integration under a single interface. It depends on a substantial set of libraries for async I/O (aiohttp, httpx), LLM provider clients (anthropic, openai), data handling (datasets, numpy, pydantic), and distributed compute (pyzmq, uvloop). The library is actively maintained, recently released, and targets Python 3.11–3.13.
Use it for
- Train agents using reinforcement learning (GRPO, agentic RL) with multi-turn environments and tool-use capabilities.
- Evaluate LLM outputs against verification criteria in a structured harness integrated with the Prime platform.
- Build custom evaluation environments for agent reasoning and decision-making tasks.
- Integrate LLM training pipelines with the Prime CLI and Environments Hub for collaborative model development.
- Benchmark multi-turn agent behavior in controlled, reproducible environments.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you are training or evaluating LLMs with reinforcement learning and plan to use the Prime ecosystem.
The package is actively maintained, has no known vulnerabilities, and integrates tightly with prime-rl and Hosted Training. If you need a standalone environment harness without Prime integration, verify that the 26 dependencies and ecosystem lock-in align with your workflow first.
Install
verifiers on PyPI
Before you install
Low friction installation with a pure-Python wheel. Active maintenance—released 7 days ago with 4513 repository stars. Requires Python 3.11–3.13 and pulls 26 runtime dependencies including aiohttp, anthropic, openai, and pydantic, which are standard in the LLM ecosystem.
Requires Python 3.11 or later. The package is tightly integrated with Prime CLI and the Environments Hub; standalone use may require additional setup.
License in practice
MIT license (permissive). No restrictions on commercial or private use; you may modify and redistribute under the same license.
Quickstart
pip install verifiers
from verifiers import Environment
env = Environment()Verify before relying
- Specific API surface and core classes beyond Environment—documentation depth unclear from excerpt.
- Whether 26 runtime dependencies are all required or some are optional/conditional.
- Integration requirements with prime-rl and Hosted Training platform for full functionality.
Package facts
| License | MIT permissive |
| Python support | Supports the current Python release <3.14,>=3.11 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 26 packagesaiohttpaiolimiteranthropicdatasetsgepahttpxlogurumath-verifymcpmsgpacknumpyopenai-agentsopenaiprime-pydantic-configprime-sandboxesprime-tunnelpydanticpyzmqrenderersrequestsrichsetproctitletenacitytomli-wtyping-extensionsuvloop |
| Maintenance | Actively maintained 7 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 554,110 / month, #6,037 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 4 - BetaIntended Audience :: DevelopersIntended Audience :: Science/ResearchLicense :: OSI Approved :: MIT LicenseProgramming Language :: Python :: 3Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Topic :: Scientific/Engineering :: Artificial IntelligenceTopic :: Software Development :: Libraries :: Python Modules |
Evidence: verifiers-0.3.0-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “llm training environments”
- verifiersVerifiers provides environments and evaluation harnesses for training…
- gem-llmGEM is a reinforcement learning environment suite that provides a…
- TextArenaTextArena provides a framework of 100+ text-based games with an…
Give your agent the search over MCP, or paste the wish link into any chat.
More Python Modules packages
Converts domain names between Unicode and ASCII-compatible encoding (Punycode) according to IDNA 2008 and Unicode Technical Standard 46, with security validation and broader script coverage than the standard library.
Install it if you work with internationalized domain names, need to validate domains, or use HTTP clients that depend on it transitively.
Setuptools is a Python build backend and package management tool that handles building, distributing, and installing Python packages, including support for C/C++ extension modules.
PyYAML parses and emits YAML 1.1 data format, enabling serialization and deserialization of configuration files and Python objects to and from human-readable YAML text.
Pydantic validates Python data structures against type hints, coercing and checking input at runtime to ensure it matches a declared schema.
Provides reusable metadata objects for use with PEP-593 `typing.Annotated` to express common constraints like bounds, collection sizes, and predicates on types.
Install it if you use or build libraries that need to express type constraints in a standardized, inspectable way—or if you want to annotate your own types with…
Provides runtime tools to inspect and introspect Python type annotations, enabling programmatic examination of type hints at execution time.
See also verl · nemo-gym · gem-llm · reasoning-gym · agentlightning · trl · deepagents · skrl · deepeval · renderers