Testing packages

Provides utilities for launching and managing applications under native code debuggers, designed for Mozilla testing workflows.

However, the aging maintenance status suggests it is stable but not actively developed—verify that it meets your specific debugger and platform requirements before…

A pytest plugin that marks individual tests with JIRA XRAY IDs and uploads their pass/fail results back to JIRA, supporting multiple authentication methods and test execution tracking.

Scans uv.lock, pylock.toml, and requirements.txt files for known vulnerabilities in PyPI dependencies by querying the PyPI API.

Generates HTML reports from Behave BDD test runs by registering as a custom formatter that outputs test results in browsable HTML format.

NeMo Evaluator runs standardized benchmarks against language models through a configurable framework with built-in scoring, proxy interception, and multi-format result reporting.

Adds a pytest plugin that automatically distributes tests across CircleCI worker nodes using CircleCI's built-in test splitting utility.

Python client library for the Qase TestOps API v1, providing programmatic access to test management operations including cases, runs, defects, and configurations.

However, the license status is unclear—verify the actual license before use in proprietary or copyleft-sensitive projects.

EvalPlus provides a rigorous evaluation framework for code generated by large language models, with extended test suites (HumanEval+, MBPP+) and performance benchmarking (EvalPerf) to assess both correctness and efficiency.

Provides pytest markers (@pytest.mark.raises and @pytest.mark.setup_raises) to assert that test code raises expected exceptions, functioning as a decorator alternative to pytest.raises context managers.

However, exercise caution: the package is dormant (last release 2020-04-23), so compatibility with modern pytest versions is unverified, and the license is unclear.

nose-py3 extends unittest with automatic test discovery and execution, finding and running tests by naming convention with enhanced output including captured stdout from failures.

ANTA is a Python framework that automates network validation tests for Arista devices, providing a library for programmatic use and a CLI tool for running tests on live or preproduction networks.

Install it if you need to validate Arista network device state programmatically or via CLI; the library-only install is lightweight and the CLI extras are optional.

A pytest plugin that enables serial port testing for embedded systems, providing fixtures and utilities to interact with and validate device behavior over serial connections.

Provides a pytest fixture that runs a local httpbin server in a test thread, eliminating the need for remote HTTP service calls during testing.

A pytest plugin that runs black format checks on your code during test execution, reporting formatting violations without applying changes automatically.

However, the dormant maintenance status (last commit 2024-12-23, zero repository stars) and old Python support floor (>=3.5) suggest limited ongoing development;…

Provides shell command-line parsing utilities for Mozilla testing infrastructure, handling argument processing and shell interactions.

However, be aware that maintenance is aging—expect no active development, and verify that it integrates with your specific workflow before adopting it.

Provides core configuration and SDK infrastructure for building test reporters that integrate with Qase TestOps, supporting single-project, multi-project, and local reporting modes.

Provides argument matchers for unittest.mock that let you assert on mock calls with fine-grained precision—matching on types, values, or custom conditions instead of exact equality or wildcards.

Provides pytest fixtures that make random number generation reproducible across test runs by seeding with deterministic values derived from test node IDs.

However, if you need modern Python versions or recent pytest support, verify compatibility first or seek an actively maintained alternative, since this package is…

A pytest plugin that lets you declare dependencies between tests, skipping dependent tests if their prerequisites fail.

Provides a local emulator for Google Cloud Storage that intercepts API calls during development and testing, allowing you to work offline without connecting to production GCS.

However, verify that the limited API subset it supports covers your use case—this is explicitly an Alpha tool, not a complete GCS replacement.

Strands Evals SDK provides a comprehensive evaluation framework for testing and measuring AI agents and LLM applications, supporting output validation, trajectory analysis, trace-based evaluation, and automated experiment generation.

Provides mock helpers for SQLAlchemy sessions in unit tests, enabling assertion on query calls and filter operations without accessing a real database.

However, be aware that maintenance is dormant—last release was 2023-03-26—so compatibility with very recent SQLAlchemy versions is uncertain.

A pytest plugin that provides fixtures and helpers for writing integration tests of Juju operator charms, including charm building, resource management, and model deployment.

Python client library for controlling iOS devices via Facebook's WebDriverAgent, enabling automated UI testing and interaction with iOS apps through a network API.

However, install it only if you already have WebDriverAgent running on your target iOS device or simulator—the package is a client library, not a standalone tool.

A command-line wrapper that adapts Pulumi infrastructure-as-code deployments to work with LocalStack, a local AWS emulation environment, by automatically configuring AWS endpoints and credentials.

However, it's only useful in that specific workflow—if you don't need LocalStack or use Pulumi only for real AWS deployments, it adds no value.

flexmock creates mock, stub, spy, and fake objects for testing Python code, with zero external dependencies and full type annotations.

Integrates Robot Framework test execution with Allure Report, capturing test results and generating detailed HTML reports with steps, attachments, and test history.

Install it if you use Robot Framework and want rich, interactive test reporting; skip it only if you have no need for Allure's reporting features.

riot constructs isolated Python virtual environments and runs commands within them, enabling reproducible testing across multiple dependency configurations.

Reads MS Excel files and translates Excel formulas into Python code for evaluation, allowing spreadsheet calculations to run without Excel.

However, high install friction and the gap since the last release warrant checking that your target Excel functions are supported and testing numeric precision on…

Provides type stubs enabling static type checkers like mypy and pyright to understand the assertion API of a popular testing library.

A Python client library for the Qase TestOps API v2, automatically generated from the OpenAPI specification to enable programmatic interaction with Qase test management services.

Attaches images to BehaveX HTML test reports, supporting both binary image data and image files with configurable attachment conditions.

However, the aging maintenance status (364 days since last release, minimal repository activity) means you should verify compatibility with your BehaveX version…

scripttest runs command-line applications in subprocesses and captures their output and file modifications for testing purposes.

Emulates a WebAuthn authenticator in Python for testing web applications that use passwordless authentication, without requiring physical security keys.

A pytest plugin that uses rich to format and colorize test session output with enhanced terminal presentation.

However, be aware that the maintainer is seeking adoption and the feature set may evolve; it is not a mature, feature-locked tool.

A pytest plugin that runs embedded system tests on QEMU instead of physical hardware, with optional integration for building bootable images when pytest-embedded-idf is available.

Install only if you have QEMU available on your system and are already using or planning to adopt pytest-embedded for your test suite.

Testinfra lets you write Python unit tests that verify the actual state of servers—checking files, packages, services, and system configuration—as a pytest plugin.

Prophy is a binary serialization protocol with a code generator that produces Python and C++ codecs from a schema definition language, enabling efficient cross-language message encoding and decoding.

A pytest plugin that mocks httpx2 HTTP requests using respx, letting you define expected requests and responses in tests without hitting real endpoints.

A pytest plugin that automatically applies runtime type-checking via beartype to every collected test function, catching type violations in test signatures and locally-typed variables during test execution.

However, be aware this is a temporary workaround for functionality expected in pytest-beartype 0.3.0—plan to migrate when that release arrives.