Back to Free Tools
FREE TOOLS
JSON Array Deduplicator
Remove duplicate whole JSON values while retaining first entries, exact numeric tokens and original array order.
Strict UTF-8 JSON array file, Pasted strict JSON array
JSON array, JSON count and original-index report
Browser only
Runs locally in your browser. Your files, pasted content and generated output are not uploaded. Reset clears this tool’s working data.
This tool needs JavaScript. If it does not load, refresh the page and try again.
How to use this tool
- Paste JSON array input or choose a JSON file; the file takes precedence.
- Select Deduplicate array. Duplicate keys, invalid Unicode and out-of-bound structures reject the whole operation.
- Use Download result for deduplicated.json and Download deduplication-report.json for counts/retained original indices. Cancel stops the worker; Reset restores defaults.
Examples
[1,1.0,1e0,-0,0, false] retains[1,-0, false], preserving the first written token for each mathematical number.
Limitations
- 5 MiB input,50000 root entries,40 nesting levels,200000 parsed/identity node visits,10000 units per numeric token,20 MiB identity text and combined output,30 seconds.
- Uses complete length-framed typed identities, not digest-only equality. Decoded strings are exact; Unicode normalization is not applied.
- Retained numbers keep their first lexical tokens; whitespace and escape spellings are not preserved. No by-key deduplication.
Related tools
No items found.