Remove duplicate lines
Remove repeated lines while retaining their original order.
Bookmark this page
Keep this page handy for next time.
- On a computer
- Press Ctrl + D, or Command + D on a Mac.
- On a phone or tablet
- Open your browser's menu or Share menu and look for Add Bookmark, Bookmark or Add to favourites.
A bookmark saves the page link. Save any tool results separately.
How to use this tool
- Paste one item per line.
- Choose how whitespace and letter case affect a match.
- Copy the updated list. The first matching item keeps its original position.
Things to know
- Processing happens on your device. Check the result before replacing your original data.
- Each text input accepts up to 5 MiB. Output is limited to 25 MiB and combined text settings to 1 MiB.
- Line-based modes accept up to 100,000 lines, including a trailing empty line.
You might also need
More in text & listsText repeater
Repeat text a chosen number of times, with line breaks, spaces or your own separator.
Remove extra spaces
Trim lines, collapse repeated spaces and remove blank lines.
Line filter
Keep or remove lines containing text, matching a pattern or meeting a length.
Sort a list
Sort lines alphabetically, naturally or as numbers.
List shuffler
Randomise the order of lines using unbiased cryptographic randomness.
URL slug generator
Create URL-friendly slugs from titles while choosing ASCII or Unicode output.
List chunker
Split a long list into fixed-size groups or separate text files.
List comparer
Find shared, missing and combined items across two lists.
Delimiter converter
Turn lines or separated values into SQL lists, arrays and custom delimited text.