Back to Free Tools
FREE TOOLS
Lexical Diversity Analyzer
Measure type-token ratios, moving windows and hapax counts with full token witnesses.
Pasted text, One UTF-8 text file, Window size
lexical-diversity.json, lexical-window-report.csv
Browser only
Runs locally in your browser. Your files, pasted content and generated output are not uploaded. Reset clears this tool’s working data.
This tool needs JavaScript. If it does not load, refresh the page and try again.
How to use this tool
- Paste text or choose one UTF-8 file.
- Choose a moving-window size from 1 through 500 tokens.
- Analyze and download the complete JSON inventory and CSV window report.
Examples
For a a b, the type-token ratio is 2/3 and one token type occurs once.
Limitations
- At most 200000 UTF-16 units, 800000 UTF-8 bytes, 20000 tokens, types or windows; 5 MiB combined output and 30 seconds.
- Uses the existing case-sensitive Unicode word-token grammar, without normalization or language-specific segmentation.
- If the text is shorter than the selected window, one whole-text window is used. Empty text has no windows and undefined ratios are null with reasons. H/N and H/V are reported separately.
Related tools
No items found.