---
id: codeflash-benchmark
version: "0.3.0"
license: unclear
license_treatment: unclear
maintenance: active
---

# codeflash-benchmark — Pytest benchmarking plugin for codeflash.ai - automatic code performance optimization

License: unclear · Maintenance: active · Downloads: 151.2K/mo

## What it is and what it does

codeflash-benchmark is a pytest plugin designed to integrate benchmarking into CodeFlash's automatic code optimization workflow. It extends pytest with performance measurement capabilities that CodeFlash uses to evaluate and validate code optimizations. The plugin depends only on pytest and installs with minimal friction.

The package is positioned as part of CodeFlash's optimization pipeline rather than as a standalone benchmarking tool. It is actively maintained and supports current Python versions (3.9+). However, the license terms are not declared, and the exact benchmarking features and metrics it provides are not detailed in the available documentation.

Use it for:

- Measure performance of code before and after CodeFlash optimizations in an automated pipeline.
- Integrate performance testing into pytest suites used by CodeFlash's optimization service.
- Validate that code changes improve performance as part of continuous integration workflows.

## Worth the install?

AI-flagged interpretation of the facts above — verify before relying.

A pytest plugin that adds benchmarking capabilities for CodeFlash's automatic code performance optimization pipeline.

Yes, if you are using CodeFlash's optimization service and need to measure performance impact in pytest. The low install friction and active maintenance make it a reasonable choice for that specific workflow. However, verify the license terms first, and confirm that the plugin's benchmarking output meets your performance measurement needs before committing to it in production.

## Install

pip install codeflash-benchmark
uv add codeflash-benchmark
poetry add codeflash-benchmark

## Installing codeflash-benchmark

Before you install: Low install friction with a single runtime dependency on pytest. The package is actively maintained with recent releases, though repository metadata is not publicly available.

License in practice: License status is unclear—no SPDX identifier or raw license text is declared. Verify the actual license terms before using in proprietary or restricted contexts.

Quickstart:

pip install codeflash-benchmark

import pytest
# Use in pytest tests; plugin integrates automatically with pytest

Requires Python 3.9 or later; pytest must be installed as a runtime dependency.

Verify before relying:

- What license does this package actually use, and are there any restrictions on commercial or derivative use?
- Does the plugin require CodeFlash account credentials or API keys to function?
- What specific benchmarking metrics or output formats does the plugin provide?

## Package facts

- License: not declared (unclear)
- Python support: supports_current
- Install friction: low
- Maintenance: active
- Downloads: 151.2K/month (top 15,000 on PyPI)
- Known vulnerabilities: none known

## Tags

pytest benchmarking plugin, code performance testing, codeflash integration, pytest performance measurement, benchmark pytest tests, pytest-plugin, performance-testing

[View on SkillFed](https://skillfed.io/packages/codeflash-benchmark) · [View on PyPI](https://pypi.org/project/codeflash-benchmark/)