codeflash-benchmark

What it is and what it does

codeflash-benchmark is a pytest plugin designed to integrate benchmarking into CodeFlash's automatic code optimization workflow. It extends pytest with performance measurement capabilities that CodeFlash uses to evaluate and validate code optimizations. The plugin depends only on pytest and installs with minimal friction.

The package is positioned as part of CodeFlash's optimization pipeline rather than as a standalone benchmarking tool. It is actively maintained and supports current Python versions (3.9+). However, the license terms are not declared, and the exact benchmarking features and metrics it provides are not detailed in the available documentation.

Use it for:

• Measure performance of code before and after CodeFlash optimizations in an automated pipeline.
• Integrate performance testing into pytest suites used by CodeFlash's optimization service.
• Validate that code changes improve performance as part of continuous integration workflows.

Worth the install?

AI-flagged interpretation of the facts on this page — verify before relying

A pytest plugin that adds benchmarking capabilities for CodeFlash's automatic code performance optimization pipeline.

Yes, if you are using CodeFlash's optimization service and need to measure performance impact in pytest. The low install friction and active maintenance make it a reasonable choice for that specific workflow. However, verify the license terms first, and confirm that the plugin's benchmarking output meets your performance measurement needs before committing to it in production.

Install

codeflash-benchmark on PyPI

pip install codeflash-benchmark

uv add codeflash-benchmark

poetry add codeflash-benchmark

Installing codeflash-benchmark

Before you install

Low install friction with a single runtime dependency on pytest. The package is actively maintained with recent releases, though repository metadata is not publicly available.

License in practice

License status is unclear—no SPDX identifier or raw license text is declared. Verify the actual license terms before using in proprietary or restricted contexts.

Quickstart

pip install codeflash-benchmark

import pytest
# Use in pytest tests; plugin integrates automatically with pytest

Requires Python 3.9 or later; pytest must be installed as a runtime dependency.

Verify before relying

• What license does this package actually use, and are there any restrictions on commercial or derivative use?
• Does the plugin require CodeFlash account credentials or API keys to function?
• What specific benchmarking metrics or output formats does the plugin provide?

Package facts

Evidence: codeflash_benchmark-0.3.0-py3-none-any.whl

Keywords: codeflash, benchmark, pytest, performance, testing

Tags

More Quality Assurance packages

Further reading