Testing packages

Collects multiple assertion failures in a test without stopping execution, then reports them all at the end via a single call or decorator.

However, verify the license terms first, and note that maintenance is aging—last commit was 250 days ago—so expect slower updates if issues arise.

salt-lint checks Salt State files (SLS) for best practices and potential improvements, flagging style and behavior issues via command-line rules.

Install it if you manage Salt configurations and want to catch style and logic issues before they reach production.

pytest-selenium is a pytest plugin that integrates Selenium WebDriver into pytest test suites, enabling browser automation and web UI testing within the pytest framework.

httpbin is a Flask-based HTTP request and response service that provides endpoints for testing and debugging HTTP clients and libraries.

vncdotool is a command-line VNC client that automates interactions with remote displays by sending keystrokes, mouse movements, and screen captures to VNC servers.

Install it if you need to automate VNC interactions; skip it if your use case doesn't involve remote display control.

Provides file and directory utilities for Mozilla testing workflows, including operations like temporary file management, directory traversal, and file comparison.

A Robot Framework listener that automatically retries failed tests or tasks based on tags or a global retry count parameter.

However, the lack of updates since October 2022 is a concern—verify that it works with your current Robot Framework version before committing to it in production.

Provides extensions and additional functionality for LocalStack, a local AWS service emulator that runs in Docker.

A pytest plugin that prefixes each test output line with a timestamp, helping you see when individual tests started running.

However, the dormant status and unclear license mean you should verify it works with your pytest version and clarify the license before using it in production or…

testresources extends unittest to manage expensive shared test resources—like databases or web servers—across multiple test cases, reusing them when clean and tearing them down when dirty to optimize test execution time.

ansible-navigator is a text-based user interface (TUI) for Ansible that lets you interactively explore playbooks, collections, inventory, and configuration without leaving the terminal.

The main gotcha is the default container runtime requirement—confirm your environment has podman or docker, or plan to use local execution mode.

Splinter provides a unified Python interface for automating web browser interactions across multiple drivers (Selenium, Django, Flask, ZopeTestBrowser), enabling web application testing and automation without writing driver-specific code.

However, the aging maintenance status (last release 2024-01-16) means you should verify compatibility with your target browsers and Selenium versions before…

A pytest plugin that runs type-checking tests against mypy by defining test cases in YAML files with inline type assertions and custom matchers.

Install it if you maintain a mypy plugin, publish type stubs, or want to add type-safety regression tests to a typed library.

A Pylint plugin that formats linting output as GitHub Actions annotations, making violations appear directly in pull request reviews and workflow logs.

pyvalid is a Python data validation tool that checks function input and output values, typically via decorators for runtime type and value validation.

Automatically downloads and installs the chromedriver binary matching your installed Chrome version, then adds it to your system PATH.

Install it if your workflow involves frequent Chrome updates or cross-platform testing; skip it if you already have a chromedriver management strategy in place.

Syncer converts async functions to synchronous callables, allowing you to run coroutines synchronously without manually managing event loops.

However, the dormant maintenance status (last release over a year ago) means you should verify it works with your Python version and be prepared to fork or find…

testscenarios extends Python's unittest to run a single test method across multiple scenarios by injecting parameters as test attributes, enabling interface testing and dependency injection patterns.

A Robot Framework listener that prints stack traces to console during test failures, showing the exact file and line where each failure occurs in the test execution chain.

However, be aware that maintenance is dormant—no updates since mid-2023—so if Robot Framework introduces breaking changes to its listener API, this plugin may stop…

cocotb-bus provides pre-built testbenching tools and reusable bus interface models for cocotb, a Python-based hardware verification framework.

Provides an SSL-enabled development server for Django that runs HTTPS locally without requiring a production web server.

A pytest plugin that lets you mark and selectively run tests requiring internet access, skipping them by default to speed up local test suites.

Install it if your test suite includes tests that access remote data and you want to keep local runs fast.

Nutter is a testing framework for Databricks notebooks that lets you write and run test fixtures directly in notebooks or via a command-line interface, with support for parallel execution and CI/CD integration.

However, exercise caution: the project is dormant (last release 2022-12-16), so compatibility with current Databricks APIs is unverified.

Pretend provides a lightweight library for creating stub objects in tests that return pre-canned responses without computation, plus utilities for recording calls and raising exceptions.

However, verify compatibility with your Python version—classifiers only list up to 3.6, and the last release was 2018-04-14.

CrossHair uses symbolic execution and SMT solving to find counterexamples to type-annotated functions with contracts, and can generate unit tests or detect behavioral differences between implementations.

pytest-cover is a pytest plugin for measuring code coverage, but it has been merged into pytest-cov and is no longer maintained as a separate project.

Generates and validates checksums and GPG signatures for Ansible content to verify authenticity and integrity.

Runs automated accessibility audits on web pages using the axe-core engine through Playwright, identifying WCAG violations and accessibility issues.

Provides Python bindings to manage BrowserStack Local, enabling remote browser testing against local development servers and folders.

However, verify the license terms before adoption, and confirm that the BrowserStack binary download mechanism works in your deployment environment.

A pytest plugin that generates test outcome reports formatted as markdown tables, with options for verbosity, custom columns from test marks, execution duration tracking, and multiple markdown flavors.

bitmath converts and performs arithmetic on file sizes across SI and NIST prefix units (kB to YiB), with support for human-readable formatting, rich comparisons, and capacity math.

Provides pytest fixtures that spin up local HTTP and SMTP servers for testing code that makes real network requests without relying on external services or mocking.

filecheck is a Python implementation of LLVM's FileCheck tool, used to validate text output against patterns defined in check directives embedded in test files or comments.

A pytest plugin that enables testing of async code written with Trio, allowing you to write and run async test functions directly within pytest.

AIPerf measures the performance of generative AI models served by inference endpoints, collecting detailed latency, throughput, and token metrics via command-line benchmarking and generating comprehensive reports.

Install it if you need to measure or compare LLM inference performance across endpoints, models, or load patterns.

A Robot Framework library that adds keywords for querying databases, verifying query results, and managing multiple database connections within automated test suites.

A pytest plugin that integrates Apache Spark and PySpark into your test suite, providing session-scoped fixtures for SparkContext and SparkSession with configurable Spark options.

However, note that maintenance is aging—the last release was 450 days ago—so verify compatibility with your specific PySpark version before relying on it for new…

Integrates the nose test runner into Django's test command, enabling selective test discovery and execution with nose plugins and performance optimizations like fixture bundling and database reuse.

No, not for new projects.

A command-line tool for uploading test automation results to TestRail and managing test data through TestRail's API.

Converts an Allure test report folder into a single self-contained HTML file that can be opened in any browser without special flags or a local server.

However, be aware the project is aging (last release June 2023) and some features like image/video viewing are not yet implemented—verify compatibility with your…