text-splitting

A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.

Adaptive Chunking: automatically select the best chunking method per document for RAG. Accepted at LREC 2026.

🍱 Semantically create chunks from large document for passing to LLM workflows

A Python CLI to test, benchmark, and find the best RAG chunking strategy for your Markdown documents.

Kerning-aware text splitting

One library to split them all: Sentence, Code, Docs. Chunk smarter, not harde; built for LLMs, RAG pipelines, and beyond.

A sentence splitting (sentence boundary disambiguation) library for Go. It is rule-based and works out-of-the-box.

JChunk is a lightweight and flexible library designed to provide multiple strategies for text chunking within Java applications

An exploration of text splitting and chunking in JavaScript

a powerful Markdown chunking tool that understands document structure. Unlike naive token splitters, it protects atomic elements (code, math, tables), merges by semantic affinity, and scores chunk quality — ready for RAG and fine-tuning workflows.

Split and analyze text files

A practical guide to 6 document chunking strategies for RAG and LLM applications — Document, Fixed-Size, Recursive, Sentence, Semantic, and Agentic chunking with working code and plain-English explanations.

Structure-aware document splitter for RAG — parses any document into a unified AST and chunks by section/block boundaries. 面向 RAG 的结构感知文档分割器——将任何文档解析为统一的 AST，并按节/块边界进行分割。

Free offline semantic text grouper — split pasted text into topic segments by meaning, not word count. Perfect for Obsidian, Logseq, Notion, PKM, researchers, writers. 100% client-side, no server, no API key, no tracking.

Markdown chunker for RAG. Structure-aware splitting preserves full semantic context; tables split at row boundaries.

A web app that allows users to upload PDFs and interact with them through a Q&A interface. The application extracts text from PDFs, generates embeddings, stores them in a FAISS database, and retrieves relevant information to provide context-aware answers using a large language model .

Benchmark chunking strategies for your RAG corpus. Get a recommended config. CLI, Python library, and MCP server.

An intelligent chatbot that allows users to upload text-based Ayurveda PDFs and ask questions based on the content using RAG (Retrieval-Augmented Generation) combining semantic search and LLM-based responses.

Blazingly fast text chunkers in Rust with pythonic bindings. Rayon-parallel, real async, char-accurate offsets, semantic chunking

A zero-dependency Python micro-tool to split long text into RAG-ready chunks, respecting Markdown headers, paragraphs and code fences, with configurable overlap.