Text Tools

Strip repeated lines from a list

Paste a list, get the unique lines back in the order you had them, and see exactly how many duplicates were removed. Useful for email lists, keyword exports, log lines and anything else that has been concatenated one time too many.

The first of each repeated line is kept, so your original order survives.

Deduplicated

Paste a list above and the unique lines appear here.

  • Runs in your browser
  • No account required
  • Free to use

How it works

01

The first of each is kept

Not the last. For a list somebody has ordered — by priority, by date, by anything — keeping the earliest occurrence preserves that order, while keeping the last silently rearranges it. So the output is your list with later repeats deleted, and nothing else moved.

02

You are told what it did

The count of removed lines is shown next to the count of what remains. A deduplicator that hands back a shorter list with no number leaves you counting it yourself to check it worked, and “0 duplicates removed” is a genuinely useful answer — it tells you the list was already clean rather than that the tool is broken.

03

Comparison is yours to control

By default “Apple” and “apple” are the same line and surrounding spaces are ignored, because that is what catches duplicates in real exported data. Both can be turned off when the difference matters — case-sensitive identifiers, for instance, where Apple and apple really are two things.

What it does

Original order preserved

The output is not sorted. If you want it sorted as well, the text sorter does that as a separate step, and keeping them separate means deduplicating never reorders anything behind your back.

Optional blank-line removal

Exported lists often arrive padded with empty lines. One checkbox drops them along with the duplicates, rather than leaving you a list with gaps in it.

Handles Windows and Unix line endings

Text pasted from a Windows editor carries different line endings from text copied out of a terminal. Both are split correctly, so you do not get one enormous line or invisible carriage returns making identical lines look different.

Nothing is uploaded

Email lists and customer exports are exactly the sort of thing that should not be pasted into a stranger’s server. This page makes no network requests at all — the work happens in your browser and the text never leaves it.

Practical advice

Getting a better result

  • Leave “ignore surrounding spaces” on for anything pasted out of a spreadsheet. Trailing spaces are invisible and are the usual reason two identical-looking lines both survive.
  • Turn case sensitivity on for IDs, hashes, file paths and anything else where capitalisation carries meaning.
  • To deduplicate and sort, run this first and then paste the result into the text sorter. Doing it in that order keeps the count of duplicates meaningful.
  • A count of zero removals means the list was already unique — worth checking before assuming the paste did not work.

Questions

Things people ask

Does it change the order of my list?

No. The first occurrence of each line stays exactly where it was and later repeats are deleted. Nothing is sorted or moved, which is why deduplicating and sorting are separate tools here.

Are “Apple” and “apple” treated as duplicates?

By default yes, because in most real lists they are the same entry typed inconsistently. Tick “treat different capitalisation as different lines” if you are working with case-sensitive data such as IDs or file paths.

How large a list can it handle?

There is no fixed limit — it runs in your browser, so the ceiling is your device’s memory. Lists of hundreds of thousands of lines deduplicate in well under a second, because matching is done with a hash set rather than by comparing every line to every other.

Who builds these

Free tools by day. Websites that earn their keep by trade.

KuConvert is built by KUDUY, a web design and development agency. From custom WordPress builds to SEO and e-commerce, everything they do is engineered to bring you more qualified traffic and turn it into revenue.

  • Fixed scope, no surprise invoices

    Most sites ship in four to eight weeks with the scope and the price agreed up front.

  • SEO from day one

    Search is designed into the build — structure, schema and Core Web Vitals — not retrofitted.

  • A team, not a ticket queue

    A project manager, a designer and a developer you can actually reach.

Need your whole site to load this fast?

Images are usually the heaviest thing on a page and the easiest win. KUDUY works on site speed, image delivery and Core Web Vitals for teams who would rather not do it by hand.

This tool runs entirely in your browser. Your files are never uploaded.