cwltest
Common Workflow Language testing framework
Decision gist · record as of 2026-08-14
Yes. cwltest is actively maintained, has no known vulnerabilities, installs with minimal friction, and is the standard testing tool for CWL workflows. Install it if you develop, validate, or run Common Workflow Language tools or need to verify CWL engine compliance.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python 3.10 or later (up to 3.15); CWL tools and a test description YAML file are needed to run actual tests.
- Low friction install with only two runtime dependencies (schema-salad and junit-xml).
- Actively maintained with a release on 2026-08-14 and support for current Python versions (3.10 through 3.15).
License · maintenance · safety
Apache 2.0 (permissive) — Licensed under Apache 2.0 (permissive), allowing free use, modification, and distribution with minimal restrictions—suitable for both open-source and commercial projects.
last release 2026-08-14 (0 days) · last repo commit 2026-08-14 · 20 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 120,325 downloads/mo, #12,033 on PyPI
Alternatives
Verify before relying
pip install cwltest
from cwltest import main
# Or use the command-line interface:
# cwltest --test test-descriptions.yml --tool cwl-runner- Whether the package includes built-in test suites or examples beyond the conformance tests mentioned.
- Performance characteristics when running large numbers of test cases or complex workflows.
- Compatibility with specific CWL implementations beyond the generic cwl-runner reference.
What it is and what it does
cwltest is a testing framework for validating Common Workflow Language (CWL) tools and workflows. It reads test case definitions from YAML files, executes them against a CWL runner, and compares the actual outputs to expected results. The package is used to run the official CWL conformance test suite and can generate JSON badge data for displaying test results.
The tool integrates with pytest and supports custom file access modules, allowing you to test CWL implementations that write outputs to remote storage systems rather than local filesystems. It runs on the command line and can be extended by implementing alternate storage backends through Python entry points.
Use it for
- Run CWL conformance tests to verify a workflow engine's compliance with the CWL specification.
- Validate custom CWL tools and workflows before deploying them to production pipelines.
- Generate conformance badges showing test pass rates for documentation or CI/CD dashboards.
- Test CWL implementations that use non-local storage (cloud buckets, remote filesystems) via custom fsaccess modules.
- Integrate CWL validation into continuous integration pipelines to catch workflow regressions.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes.
cwltest is actively maintained, has no known vulnerabilities, installs with minimal friction, and is the standard testing tool for CWL workflows. Install it if you develop, validate, or run Common Workflow Language tools or need to verify CWL engine compliance.
Install
cwltest on PyPI
Before you install
Low friction install with only two runtime dependencies (schema-salad and junit-xml). Actively maintained with a release on 2026-08-14 and support for current Python versions (3.10 through 3.15).
Requires Python 3.10 or later (up to 3.15); CWL tools and a test description YAML file are needed to run actual tests.
License in practice
Licensed under Apache 2.0 (permissive), allowing free use, modification, and distribution with minimal restrictions—suitable for both open-source and commercial projects.
Quickstart
pip install cwltest
from cwltest import main
# Or use the command-line interface:
# cwltest --test test-descriptions.yml --tool cwl-runnerVerify before relying
- Whether the package includes built-in test suites or examples beyond the conformance tests mentioned.
- Performance characteristics when running large numbers of test cases or complex workflows.
- Compatibility with specific CWL implementations beyond the generic cwl-runner reference.
Package facts
| License | Apache 2.0 permissive |
| Python support | Supports the current Python release <3.16,>=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 2 packagesschema-saladjunit-xml |
| Maintenance | Actively maintained 0 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 120,325 / month, #12,033 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Development Status :: 5 - Production/StableEnvironment :: ConsoleFramework :: PytestLicense :: OSI Approved :: Apache Software LicenseOperating System :: MacOS :: MacOS XOperating System :: POSIXProgramming Language :: Python :: 3.10Programming Language :: Python :: 3.11Programming Language :: Python :: 3.12Programming Language :: Python :: 3.13Programming Language :: Python :: 3.14Programming Language :: Python :: 3.15Typing :: Typed |
Evidence: cwltest-2.7.20260814150058-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “cwl workflow testing”
- cwltestcwltest validates the output of Common Workflow Language tools and…
- cwl-utilsLoads, parses, and manipulates Common Workflow Language (CWL)…
- cwl-upgraderUpgrades Common Workflow Language documents from draft-3, v1.0, and…
Give your agent the search over MCP, or paste the wish link into any chat.
More Testing packages
Pluggy provides a plugin system that lets you define hook specifications and register implementations to be called in sequence, enabling extensible Python applications without tight coupling.
Install it if you're building an extensible application or framework.
pytest is a testing framework that lets you write test functions using plain assert statements and automatically discovers and runs them, with detailed failure reporting.
virtualenv creates isolated Python environments where packages can be installed independently without affecting the system Python or other projects.
Coverage.py measures which lines of Python code are executed during test runs, reporting coverage percentages and identifying untested code paths.
Install it if you want to measure test completeness or enforce coverage thresholds in your project.
pytest-asyncio is a pytest plugin that enables writing and running async test functions using the asyncio library, allowing developers to await code directly within test cases.
Install it if you write tests for any asyncio-based code.
A pytest plugin that generates test reports in Common Test Report Format (CTRF) as JSON, compatible with pytest-xdist and pytest-playwright for distributed and browser-based testing.
Install it if you need CTRF-formatted test output for CI/CD integration or cross-tool reporting.
See also cwltool · cwl-utils · cwl-upgrader · yamale · flex · pylint-gitlab · pytest-azurepipelines · genbadge · pykwalify · coverage-badge