pytest-runtime-xfail

What it is and what it does

pytest-runtime-xfail fills a gap in pytest's xfail handling by allowing you to decide at runtime whether a test should be marked as expected-to-fail, while still running the test to completion. The standard pytest.xfail() call stops test execution immediately; @pytest.mark.xfail() requires the decision at collection time. This plugin's runtime_xfail fixture lets you make that decision based on conditions known only during test execution, and the test continues running so you can see both XFAIL (test failed as expected) and XPASS (test passed unexpectedly) outcomes.

The fixture works by adding an xfail marker to the test node dynamically, similar to calling request.node.add_marker(pytest.mark.xfail()) but packaged as a reusable fixture. It respects the xfail_strict configuration option, so passing tests marked with runtime_xfail will fail the test run if strict mode is enabled—useful for detecting when previously-failing tests start passing.

Use it for:

• Mark tests as xfail when a runtime condition (e.g., OS, Python version, or environment variable) indicates expected failure.
• Conditionally expect failure in a shared fixture that multiple tests depend on, based on setup-time detection.
• Track when platform-specific or version-specific test failures are resolved by using xfail_strict to catch XPASS.
• Avoid skipping tests while still recording them as expected failures when a runtime dependency or feature is unavailable.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

A pytest plugin that provides a `runtime_xfail` fixture to mark tests as expected-to-fail based on runtime conditions, allowing both XFAIL and XPASS outcomes.

Yes, if you need runtime-conditional xfail marking in pytest. The plugin solves a real gap in pytest's built-in xfail mechanisms and has no security vulnerabilities. Install friction is minimal. The aging maintenance status (308 days since last release) is a minor concern for a stable, single-purpose fixture, but the repository is not archived and the package is marked Production/Stable.

Install

pytest-runtime-xfail on PyPI

pip install pytest-runtime-xfail

uv add pytest-runtime-xfail

poetry add pytest-runtime-xfail

Installing pytest-runtime-xfail

Before you install

Low install friction; single pytest dependency. Maintenance status is aging—last release 308 days ago—but the repository remains active and the package is marked Production/Stable.

License in practice

MIT License permits unrestricted use, modification, and distribution with only attribution and liability disclaimer required.

Quickstart

pip install pytest-runtime-xfail

import pytest

def test_something(runtime_xfail):
    if runtime_condition:
        runtime_xfail(reason="explanation")
    assert True  # test continues to run

Verify before relying

• Whether the plugin works correctly with pytest parametrization and xfail_strict in all supported Python versions.
• Performance impact when runtime_xfail is called in fixtures used by many tests.

Package facts

Evidence: pytest_runtime_xfail-1.1.1-py3-none-any.whl

Tags

More Utilities packages