Remove Duplicate Lines
100% PrivateText & Writing ToolsRemove repeated lines from a list and keep each line once, in its original order.
Runs entirely in your browser. Your input is not uploaded to Ovatly or anywhere else.
- 1Paste your list, one item per line.
- 2Decide the rules: whether Apple and apple count as the same line, and whether surrounding spaces are ignored.
- 3Read how many duplicates were removed above the result.
- 4Copy or download the unique lines.
Worked example
Cleaning a five-line list
Input: apple banana apple Cherry banana With the default settings, the result is: apple banana Cherry 2 duplicates removed out of 5 lines.
- The first occurrence wins: its exact spelling and capitalization are kept, later repeats are dropped.
- With trimming on (the default), lines that differ only in leading or trailing spaces count as duplicates.
- Blank lines are treated as lines too, so a run of blank lines collapses to a single blank line.
No. The output keeps the original order of first appearance. If you also want sorting, run the result through the Sort Lines Tool.
About this tool
Remove Duplicate Lines takes a list with repeated entries and returns each line once, in the order it first appeared. It cleans mailing lists, keyword lists, log extracts and any one-item-per-line data where duplicates creep in during copy and paste.
Related tools
Sort Lines ToolSort a list of lines alphabetically, by length, numerically or in reverseText & Writing ToolsOpenText CleanerClean pasted text by removing extra spaces, stray punctuation, accents or hidden charactersText & Writing ToolsOpenRemove Line BreaksJoin hard-wrapped lines from PDFs and emails back into flowing paragraphsText & Writing ToolsOpenFind and ReplaceFind and replace every occurrence of a word or pattern in your text, with regex supportText & Writing ToolsOpen
Advertisement
Part of Ovatly's free tools in Text & Writing Tools.