Thread: Duplicates?

i have a somewhat larg txt file that has song list in it however there are tons of Duplicates is there an easy way to get rid of the Duplicates?

does it have more than 65000 lines ?

Does your text file generated by PHP?

If it is, you can sort that out using SQL.

Could probably write a script to do it (although I can't think of how at the moment, or using what language, but it sounds like something that should be able to be done).

A quick google on it found this: Remove (Delete) Duplicate Lines & Words in Text Files Software no idea if it's secure/good/what.