{"categories":[{"label":"Artificial Intelligence","url":"https://skillfed.io/packages/category/scientific-engineering-artificial-intelligence/3"},{"label":"Information Analysis","url":"https://skillfed.io/packages/category/scientific-engineering-information-analysis"},{"label":"Linguistic","url":"https://skillfed.io/packages/category/text-processing-linguistic"}],"enrichment":{"capability":"Chonkie splits text into semantically meaningful chunks for RAG pipelines, offering multiple chunking strategies (recursive, semantic, token-based, code-aware) plus refinement and embedding integration.","skillfed_tags":["rag-pipeline","document-chunking","nlp"],"use_cases":["Split long documents into token-bounded chunks for LLM context windows before embedding and retrieval","Chunk code repositories by syntactic structure to preserve function and class boundaries for code search","Build a RAG pipeline that chains recursive chunking, semantic refinement, and embedding in a single workflow","Run Chonkie as a microservice API to chunk documents from multiple applications without duplicating logic","Process markdown or CSV files into structured chunks with context overlap for better retrieval quality"],"what_it_does":"Chonkie is a text chunking library designed to prepare documents for retrieval-augmented generation (RAG) systems. It provides multiple chunking strategies\u2014including recursive, semantic, token-based, code-aware, and neural approaches\u2014each suited to different content types and use cases. The library integrates with tokenizers, embedding models, vector databases, and LLMs, allowing you to build end-to-end pipelines that fetch, chunk, refine, embed, and load data into your RAG infrastructure.\n\nThe package emphasizes minimal dependencies by default: the base install includes only what's needed for common chunking tasks, with optional extras for specialized features like semantic chunking, code analysis, or API server deployment. It supports both synchronous and asynchronous workflows, can run as a self-hosted REST API, and handles text preprocessing through pluggable \"Chef\" components for markdown, tables, and OCR.","worth_installing":"Yes. Chonkie is actively maintained, has no known vulnerabilities, uses a permissive MIT license, and offers low install friction with a focused set of dependencies. It solves a genuine problem in RAG pipelines\u2014text chunking\u2014with multiple strategies and integrations. The modular design lets you install only what you need, and the API server option adds deployment flexibility. Suitable for production RAG systems."},"id":"chonkie","links":{"html":"https://skillfed.io/packages/chonkie","md":"https://skillfed.io/packages/chonkie.md","pypi":"https://pypi.org/project/chonkie/"},"maintenance":{"status":"active"},"meta":{"latest_release":"2026-07-07","license_spdx":null,"license_treatment":"permissive","name":"chonkie","python_support":"supports_current","summary":"\ud83e\udd9b CHONK your texts with Chonkie \u2728 - The no-nonsense chunking library"},"popularity":{"monthly_downloads":1346996,"position":4020,"tier":"top_5000"},"security":{"n_vulnerabilities":0},"version":"1.7.0"}