buildkite-test-collector
Buildkite Test Engine collector
Decision gist · record as of 2026-08-14
Yes, if you use pytest and Buildkite Test Engine. The package is actively maintained, has low install friction, carries a permissive MIT license, and no known vulnerabilities. It requires Python >=3.10 and an API token from Buildkite, but once configured it integrates transparently. Span tracing is powerful but requires manual instrumentation; if you only need basic test collection and filtering, this is a straightforward addition to your CI workflow.AI-flagged interpretation of the facts on this page — verify before relying
Before you install
- Requires Python >=3.10 and BUILDKITE_ANALYTICS_TOKEN environment variable set in your CI system.
- Low friction install with four common runtime dependencies.
- Actively maintained with a release 4 days ago; repo is not archived and receives regular commits.
License · maintenance · safety
MIT (permissive) — MIT license permits free use, modification, and distribution with minimal restrictions—suitable for both open-source and commercial projects.
last release 2026-08-10 (4 days) · last repo commit 2026-08-10 · 10 stars
0 known vulnerabilities (OSV.dev, 2026-08-14) · 902,203 downloads/mo, #4,771 on PyPI
Alternatives
Verify before relying
pip install buildkite-test-collector
import pytest
@pytest.mark.execution_tag("color", "red")
def test_example():
assert True
# Set BUILDKITE_ANALYTICS_TOKEN env var, then run:
# pytest --tag-filters "color:red"- Whether automatic span capture (http, sql, sleep) is planned or requires manual instrumentation for all use cases
- Support for test frameworks beyond pytest
- Performance overhead when collecting and transmitting test data at scale
What it is and what it does
Buildkite Test Collector is a pytest plugin that instruments your test runs and sends execution data to Buildkite Test Engine. It acts as the official Python adapter for the Buildkite platform, capturing test metadata and optionally tracing slow operations (HTTP calls, database queries, sleep intervals, and custom annotations) to help you identify performance bottlenecks and flaky tests.
The package integrates with pytest through a plugin mechanism and works across multiple CI systems—Buildkite, GitHub Actions, CircleCI, and others—via environment variables. You mark tests with execution tags, filter runs by those tags, and optionally instrument code to capture span data; the collector then transmits everything to your Test Engine dashboard. Span capture is currently manual (unlike the Ruby collector), so you write your own instrumentation or use the provided SpanCollector fixture.
Use it for
- Monitor test performance and identify slow tests in your CI pipeline by collecting execution spans.
- Filter and run subsets of tests by execution tags (e.g., run only 'color:red' tests) for faster feedback loops.
- Centralize test analytics across multiple CI systems using a single Buildkite Test Engine dashboard.
- Trace HTTP requests, database queries, and sleep calls within tests to diagnose performance issues.
- Integrate test results into Buildkite's platform for historical analysis and trend detection.
Worth the install?
AI-flagged interpretation of the facts on this page. Verify before relying on it.
Yes, if you use pytest and Buildkite Test Engine.
The package is actively maintained, has low install friction, carries a permissive MIT license, and no known vulnerabilities. It requires Python >=3.10 and an API token from Buildkite, but once configured it integrates transparently. Span tracing is powerful but requires manual instrumentation; if you only need basic test collection and filtering, this is a straightforward addition to your CI workflow.
Install
buildkite-test-collector on PyPI
Before you install
Low friction install with four common runtime dependencies. Actively maintained with a release 4 days ago; repo is not archived and receives regular commits.
Requires Python >=3.10 and BUILDKITE_ANALYTICS_TOKEN environment variable set in your CI system.
License in practice
MIT license permits free use, modification, and distribution with minimal restrictions—suitable for both open-source and commercial projects.
Quickstart
pip install buildkite-test-collector
import pytest
@pytest.mark.execution_tag("color", "red")
def test_example():
assert True
# Set BUILDKITE_ANALYTICS_TOKEN env var, then run:
# pytest --tag-filters "color:red"Verify before relying
- Whether automatic span capture (http, sql, sleep) is planned or requires manual instrumentation for all use cases
- Support for test frameworks beyond pytest
- Performance overhead when collecting and transmitting test data at scale
Package facts
| License | MIT permissive |
| Python support | Supports the current Python release >=3.10 |
| Install friction | Low. Pure-Python wheel |
| Runtime dependencies | 4 packagesfilelockpytestrequestsurllib3 |
| Maintenance | Actively maintained 4 days since the last release |
| Last repo commit | |
| First released | |
| Downloads | 902,203 / month, #4,771 on PyPI 30-day window, as of 2026-08-14 |
| Known vulnerabilities | None known OSV.dev, checked 2026-08-14 |
| Classifiers | Framework :: PytestLicense :: OSI Approved :: MIT License |
Evidence: buildkite_test_collector-1.8.0-py3-none-any.whl
Tags
Let your AI agent find packages like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 14,416 PyPI packages by what they can do, searchable in plain language.
wish › “pytest test collection buildkite”
- buildkite-test-collectorCollects test execution data from pytest and sends it to Buildkite…
- pybuildkiteA Python client library for the Buildkite API that lets you query…
- pytest-item-dictA pytest plugin that builds hierarchical dictionaries mirroring the…
Give your agent the search over MCP, or paste the wish link into any chat.
More Testing packages
Pluggy provides a plugin system that lets you define hook specifications and register implementations to be called in sequence, enabling extensible Python applications without tight coupling.
Install it if you're building an extensible application or framework.
pytest is a testing framework that lets you write test functions using plain assert statements and automatically discovers and runs them, with detailed failure reporting.
virtualenv creates isolated Python environments where packages can be installed independently without affecting the system Python or other projects.
Coverage.py measures which lines of Python code are executed during test runs, reporting coverage percentages and identifying untested code paths.
Install it if you want to measure test completeness or enforce coverage thresholds in your project.
pytest-asyncio is a pytest plugin that enables writing and running async test functions using the asyncio library, allowing developers to await code directly within test cases.
Install it if you write tests for any asyncio-based code.
A pytest plugin that generates test reports in Common Test Report Format (CTRF) as JSON, compatible with pytest-xdist and pytest-playwright for distributed and browser-based testing.
Install it if you need CTRF-formatted test output for CI/CD integration or cross-tool reporting.
See also pytest-opentelemetry · buildkite-sdk · pybuildkite · pytest-harvest · nv-one-logger-core · opentelemetry-instrumentation-sklearn · pytest-sentry · rtest · openinference-instrumentation-llama-index · openinference-instrumentation-google-genai