Remove Duplicates
Remove duplicate lines from text, case-sensitive or insensitive
About Remove Duplicates
Strips repeated lines from any list and shows how many were removed, updating the result as you type. Two checkboxes control the comparison, Case-sensitive and Trim whitespace, both on by default, while the lines that remain are output unchanged. Handy for cleaning up email lists, log excerpts, keyword exports or any list you plan to sort or diff.
Category: Text.
Frequently asked questions
Is the comparison case-sensitive?
▾
By default, yes: 'Apple' and 'apple' are kept as different lines. Uncheck Case-sensitive to treat them as duplicates; the first occurrence keeps its original capitalization.
Which duplicate is kept?
▾
The first occurrence is kept; all subsequent duplicates are removed. The relative order of unique lines is preserved.
Does it trim whitespace before comparing?
▾
Yes, Trim whitespace is on by default, so ' apple' and 'apple' count as the same line, and the line that is kept retains its original spacing. Uncheck it to compare lines exactly as written.
Are empty lines removed too?
▾
Only the repeats. Blank lines are deduplicated like any other line, so the first one is kept and later ones are removed, which collapses paragraph spacing; with Trim whitespace on, lines containing only spaces count as blank too.