CSV deduplicator
Remove duplicate CSV records using all columns or selected key columns.
Bookmark this page
Keep this page handy for next time.
- On a computer
- Press Ctrl + D, or Command + D on a Mac.
- On a phone or tablet
- Open your browser's menu or Share menu and look for Add Bookmark, Bookmark or Add to favourites.
A bookmark saves the page link. Save any tool results separately.
How to use this tool
- Choose key column headings, or leave blank to compare complete rows.
- Records with matching keys are considered duplicates.
- The first record for each key is retained.
Things to know
- Processing happens on your device. Check the result before replacing your original data.
- Each CSV input accepts up to 25 MiB, 100,000 data rows, 10,000 columns and 1,000,000 cells. Expanded tables also count empty cells.
- Generated CSV text is limited to 25 MiB in total, including all split files.
You might also need
More in data & csvBulk file renamer
Preview new filenames with prefixes, replacements and numbering, then download a renamed ZIP.
Excel to CSV converter
Read an Excel XLSX workbook, preview a worksheet and export one or all sheets as CSV.
CSV row filter
Keep CSV records matching text or numeric conditions in a selected column.
CSV sorter
Sort CSV records by a named column while retaining all row values.
ZIP file maker
Combine selected files into a ZIP archive on your device, with duplicate-name checks.
CSV joiner
Join two CSV tables on a shared key using inner or left joins.
CSV column organiser
Select, reorder and rename CSV columns.
JSON flatten and unflatten
Flatten JSON to JSON Pointer values and rebuild it without losing array types.
CSV and JSON converter
Convert CSV records to JSON and JSON records to quoted CSV.