{"categories":[{"label":"Text Processing","url":"https://skillfed.io/packages/category/text-processing/2"}],"enrichment":{"capability":"Maps tokenized words and phrases back to their character offsets in the original, untokenized source text, handling whitespace normalization and Unicode characters.","skillfed_tags":["nlp-utilities","tokenization","text-alignment"],"use_cases":["Recover source text spans for tokens output by an NLP tokenizer to annotate or highlight original text.","Map named entity recognition or part-of-speech tags back to character offsets in messy source documents.","Align corrected or normalized token sequences with their original positions for error analysis.","Extract substring context around matched token sequences for debugging tokenization issues.","Support document annotation workflows where token-level labels must be converted to character offsets."],"what_it_does":"Match is a utility for recovering the character offsets of tokenized words and phrases within their original, untokenized source text. Given a messy, whitespace-irregular, or Unicode-heavy source string and a sequence of tokens (or a single token), it returns all matching spans as (start, end, substring) tuples. This solves the alignment problem that arises when a tokenizer normalizes or splits text in ways that obscure the original character positions\u2014essential for tasks like annotation, error correction, or mapping NLP pipeline outputs back to source documents.\n\nThe package handles common real-world messiness: irregular spacing, punctuation normalization (e.g., parentheses converted to -LRB- and -RRB-), and Unicode characters. It depends on nltk and regex for tokenization and pattern matching. The project is no longer actively maintained, with the last release in 2022-10-03 and no commits since 2023-04-11.","worth_installing":"Yes, if you need token-to-offset alignment and can tolerate an abandoned package. The core functionality is stable and no known vulnerabilities exist. However, consider maintenance risk: no updates since 2022-10-03, and any bugs in Unicode or edge-case handling will not be fixed. Suitable for one-off scripts or internal tools; risky for production systems requiring ongoing support."},"id":"match","links":{"html":"https://skillfed.io/packages/match","md":"https://skillfed.io/packages/match.md","pypi":"https://pypi.org/project/match/"},"maintenance":{"status":"abandoned"},"meta":{"latest_release":"2022-10-03","license_spdx":null,"license_treatment":"permissive","name":"match","python_support":"unspecified","summary":"Match tokenized words and phrases within the original, untokenized, often messy, text."},"popularity":{"monthly_downloads":1331116,"position":4045,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"0.3.2"}