How to use the Remove Duplicate Lines
- Paste your list, one item per line
- Choose options such as ignore case or trim whitespace
- Copy the deduplicated list; the counter shows how many lines were removed
About this tool
Email lists, keyword exports, log files and spreadsheet columns pick up duplicates all the time. This tool keeps the first time each line appears and removes later repeats, so the order of your list does not change. Turn on “Ignore case” to treat “Apple” and “apple” as the same line, and “Trim spaces” to ignore stray spaces at either end.
Frequently asked questions
Does it change the order of my list?
No. The first copy of each line stays where it was. To sort as well, use the Sort Lines tool afterward.
How many lines can it handle?
Hundreds of thousands. It runs in your browser using a fast hash set, so even a 10 MB list takes well under a second.
Can I dedupe a CSV column?
Copy just that column from your spreadsheet, paste it here, then paste the result back.
Related tools
Updated · Built and maintained by the UtilityBright team · About our tools · Report a problem