Back to Free Tools
FREE TOOLS
Logical Text Chunker
Split text by codepoints or original logical lines and retain exact reconstruction.
Pasted text, One UTF-8 text file
text-chunks.json
Browser only
Runs locally in your browser. Your files, pasted content and generated output are not uploaded. Reset clears this tool’s working data.
This tool needs JavaScript. If it does not load, refresh the page and try again.
How to use this tool
- Paste the admitted text or choose one UTF-8 source file. A selected file takes precedence.
- Choose the explicit operation and options, then inspect the stated conventions and limits.
- Select Split logical chunks and download text-chunks.json.
Examples
Two-codepoint chunks split abc into ab and c, whose concatenation is abc.
Limitations
- At most 200,000 UTF-16 units / 800,000 UTF-8 bytes; 50,000 logical lines and 65,536 units per line; at most 5 MiB complete combined output and 30 seconds. A selected valid UTF-8 file takes precedence over paste. File BOM and original CR/LF spans are preserved for reporting; native textarea input can normalize newlines.
- At most 1,024 chunks and 50,000 units per chunk. Codepoint mode may split a CRLF pair; line mode retains whole original line spans. No word or inferred-label chunking.
Related tools
No items found.