You can combine the sort and uniq command line programs to remove duplicate lines from a text file. In the example below, it will produce a new file without the dups while preserving the original.
sort original.txt | uniq > dups_removed.txt
Privacy Overview
This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Powered by 