Remove Duplicated Email Addresses

Last modified: May 28th, 2007

AddThis Social Bookmark Button

Remove duplicate email addresses and sort them alphabetically. Also places all the incorrect email addresses in a separate text file.

You can also use a standalone offline version:

Last update : 03 january 2005
Author : Wilco Witte

Download unduplicate.tar (unduplicate.pl for Linux, Mac OS X and other)

Download unduplicate.zip (unduplicate.exe for Windows)

The windows executable file, unduplicate.exe, was created with TinyPerl.

Unduplicate works on a text file with email addresses. Put the text file in the same directory as unduplicate:

name1@test.comname2@test.comname3@test.com…

It removes empty lines and duplicate email addresses. After that it checks every emailaddress if they are syntactically valid. It then sorts all addresses alphabetically and writes the valid email addresses to a new text file. All the invalid email addresses are also
written to a new text file.

For example addresses.txt:

lux28@fictivedomain.comart_b1d@test.comjoshhotmail.comchris@test.com

jurgen12@whattupcomronny.dr@mywebsite.com,paul@website.comwilco_l0rd@domain.comr obbu@robbu.com

After unduplicate has finished, 2 files will have been written:

  • addresses_new.txt
  • addresses_error.txt

addresses_new.txt contains the valid emailaddresses:

lux28@fictivedomain.comart_b1d@test.comjoshhotmail.comchris@test.comwilco_l0rd@domain.com

addresses_error.txt contains the invalid emailaddresses:

jurgen12@whattupcomronny.dr@mywebsite.com,paul@website.com
r obbu@robbu.com

AddThis Social Bookmark Button