--- id: stringzilla version: "5.1.2" license: Apache-2.0 license_treatment: permissive maintenance: active --- # stringzilla — Search, hash, sort, and process strings faster via SWAR and SIMD License: permissive · Maintenance: active · Downloads: 2.8M/mo ## What it is and what it does StringZilla is a compiled C++ library that accelerates string operations by exploiting SIMD (vector instructions) and SWAR (bit-level parallelism) to process multiple bytes or characters in a single CPU cycle. It exposes fast implementations of substring search, Unicode case-folding, edit distances (Levenshtein, Needleman-Wunsch), sorting, segmentation, and hashing through a Python interface with zero runtime dependencies. The library targets data engineers, bioinformaticians, and systems developers who process large text datasets or need to optimize string-heavy workloads. It claims substantial speedups over standard libraries (LibC, ICU, NumPy) and GPU libraries on common operations. The fact sheet shows it supports Python 3.10 through 3.14 on CPython and PyPy, with precompiled wheels for x86, ARM, PowerPC, RISC-V, and other architectures. Use it for: - Parse and search large datasets like CommonCrawl or RedPajama where substring matching is a bottleneck. - Compute pairwise edit distances on batches of DNA or protein sequences for bioinformatics pipelines. - Accelerate database operations like LIKE, ORDER BY, and GROUP BY on text columns. - Implement fuzzy matching or deduplication in data cleaning workflows. - Sort or segment large text corpora by line breaks or custom delimiters at scale. ## Worth the install? AI-flagged interpretation of the facts above — verify before relying. StringZilla provides SIMD and SWAR-accelerated string operations including substring search, hashing, edit distances, sorting, and segmentation for Python, with no runtime dependencies. Yes, if you process large text datasets or need fast string operations. The library is actively maintained, has no runtime dependencies, and offers substantial claimed speedups over standard libraries. The medium install friction (compiled wheels) is manageable for common platforms. No known vulnerabilities. Install only if your Python version is 3.10 or later. ## Install pip install stringzilla uv add stringzilla poetry add stringzilla ## Installing stringzilla Before you install: Medium install friction due to compiled wheels across many architectures (x86, ARM, PowerPC, RISC-V, s390x). Actively maintained with recent releases; no runtime dependencies simplifies deployment. License in practice: Apache-2.0 is permissive; you may use, modify, and distribute StringZilla freely in commercial and private projects, provided you include a copy of the license and any modifications. Quickstart: pip install stringzilla import stringzilla as sz result = sz.find('hello world', 'world') Requires Python 3.10 or later; compiled wheels available for common platforms, but installation on unsupported architectures may require building from source. Verify before relying: - Whether the GPU performance claims (H100 benchmarks) apply to standard PyPI installations or require separate CUDA builds. - Whether PyPy support is fully tested and production-ready, or remains experimental. - Whether the library is suitable for real-time or latency-critical workloads given the Python-to-C boundary crossing overhead. ## Package facts - License: Apache-2.0 (permissive) - Python support: supports_current - Install friction: medium - Maintenance: active - Downloads: 2.8M/month (top 5,000 on PyPI) - Known vulnerabilities: none known ## Tags fast substring search simd, string hashing acceleration, levenshtein distance gpu, utf-8 case-insensitive search, vectorized string operations, string similarity algorithms, high-performance text processing, simd-acceleration, bioinformatics, data-processing [View on SkillFed](https://skillfed.io/packages/stringzilla) · [View on PyPI](https://pypi.org/project/stringzilla/)