codspeed-setup-harness
This skill guides you through configuring benchmarks and integrating CodSpeed into your project. It covers language-specific harnesses (divan, criterion, pytest-benchmark, vitest, go test, Google Benchmark) and a universal exec mode for any language, helping you identify performance-critical code and establish repeatable performance tracking.
CodSpeed Setup Harness helps you configure benchmarks and performance tracking for Rust, Python, Node.js, Go, and C/C++ projects.
AI-generated summary based on this skill's SKILL.md
Decision gist · record as of 2026-07-27
CodSpeed Setup Harness helps you configure benchmarks and performance tracking for Rust, Python, Node.js, Go, and C/C++ projects. This skill guides you through configuring benchmarks and integrating CodSpeed into your project. It covers language-specific harnesses (divan, criterion, pytest-benchmark, vitest, go test, Google Benchmark) and a universal exec mode for any language, helping you identify performance-critical code and establish repeatable performance tracking.
Use it when
- codspeed-setup-harness supports multiple language-specific frameworks: divan and criterion for Rust, pytest-benchmark for Python.
- Yes, codspeed-setup-harness helps you configure codspeed.yml to set up your benchmarking environment.
Verify before relying
Read SKILL.md below before installing (1 file). Open directory: indexed for reading, not audited.
Install
CodSpeedHQ/codspeed/codspeed-setup-harness · repository language: Rust
Open directory. Skills are indexed for reading, not audited. Review a skill's body before installing it.
Frequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
How do I set up performance benchmarks with codspeed-setup-harness?
codspeed-setup-harness guides you through configuring benchmarks and integrating CodSpeed into your project. It covers language-specific harnesses including divan for Rust, criterion, pytest-benchmark for Python, vitest for Node.js, go test for Go, and Google Benchmark for C++. The skill also supports a universal exec mode for any language, helping you identify performance-critical code and establish repeatable performance tracking.
What language-specific benchmark frameworks does codspeed-setup-harness support?
codspeed-setup-harness supports multiple language-specific frameworks: divan and criterion for Rust, pytest-benchmark for Python, vitest for Node.js, go test for Go, and Google Benchmark for C++. Additionally, codspeed-setup-harness provides a universal exec mode that works with any language, giving you flexibility to benchmark code regardless of your tech stack.
Can I configure codspeed.yml with codspeed-setup-harness?
Yes, codspeed-setup-harness helps you configure codspeed.yml to set up your benchmarking environment. The skill guides configuration for performance monitoring and CI integration, allowing you to establish baseline metrics for code optimization and measure code execution speed across your project.
How does codspeed-setup-harness help measure code performance?
codspeed-setup-harness enables you to create performance tests that measure code execution speed and establish baseline metrics for optimization. It integrates benchmarking frameworks into your CI pipeline, providing repeatable performance tracking to identify performance-critical code sections and monitor improvements over time.
What is the universal exec mode in codspeed-setup-harness?
codspeed-setup-harness includes a universal exec mode that works with any programming language or custom benchmark tool. This mode complements language-specific harnesses, allowing you to benchmark code in languages not covered by dedicated framework integrations while maintaining consistent performance tracking.
Can codspeed-setup-harness integrate benchmarking into my CI pipeline?
Yes, codspeed-setup-harness supports configuring performance monitoring and CI integration. It helps you add performance tests to your continuous integration workflow, enabling automated benchmark execution and tracking performance changes across commits and deployments.
SKILL.md
Rendered from the published skill. Quoted content, verbatim.
Setup Harness
You are a performance engineer helping set up benchmarks and CodSpeed integration for a project. Your goal is to create useful, representative benchmarks and wire them up so CodSpeed can measure and track performance.
Step 1: Analyze the project
Before writing any benchmark code, understand what you're working with:
-
Detect the language and build system: Look at the project structure, package files (
Cargo.toml,package.json,pyproject.toml,go.mod,CMakeLists.txt), and source files. -
Identify existing benchmarks: Check for benchmark files,
(truncated - see the full file via the links below)
File tree — 1 file
skills/codspeed-setup-harness/SKILL.md
Let your AI agent find skills like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 56,283 agent skills by what they can do, searchable in plain language.
wish › “Set up benchmarks and CodSpeed harness for a project”
Give your agent the search over MCP, or paste the wish link into any chat. No install? Search from any chat →
Related skills
This skill acts as an autonomous performance engineer, using CodSpeed benchmarks and flamegraph analysis to iteratively optimize code. It measures baseline performance, identifies bottlenecks through flame graphs, applies targeted changes, and validates improvements across simulation and walltime modes. The skill handles the full optimization loop—from establishing baselines to comparing runs and reporting gains—stopping only when significant improvements plateau or the user decides to halt.
memory-benchmark measures heap allocations and process memory for SQL workloads under different journal modes. It includes dhat-based allocation tracking, stack-usage analysis via the stack-report binary, and six built-in workload profiles (insert-heavy, read-heavy, mixed, scan-heavy, series-blob, update-churn) for regression detection and performance tuning.
Rustunnel lets you create public tunnels for local services across HTTP, TCP, UDP, and peer-to-peer protocols. Use it to test webhooks, share development environments, access databases remotely, or run load-balanced pools—all controlled through MCP tools that integrate with Claude Code and other AI agents.
This skill automates ClaudeClaw's first-time setup, handling Node.js verification, dependency installation, environment configuration, and container runtime selection. It detects whether you're working in developer or plugin mode and adapts its workflow accordingly, pausing only when manual actions like channel authentication are required.
This skill provides systematic performance analysis for the RTK CLI tool, measuring startup time against a <10ms target, memory usage under 5MB, and token savings between 60–90%. It includes baseline capture, regression detection with flamegraph profiling, and common optimization techniques like LazyLock initialization and zero-copy string processing.
vc-setup guides you through configuring an agent development harness tailored to your project. It detects your tech stack, asks clarifying questions to understand your codebase, then scaffolds the necessary directory structure and context files—always requesting approval before making changes. Works equally well on new projects and those with existing configurations.