Find duplicate lines in a file and count how many time each line was duplicated?

file count find duplicates lines
user839145 picture user839145 · Jul 15, 2011 · Viewed 555.2k times · Source

Suppose I have a file similar to the following:

123 
123 
234 
234 
123 
345

I would like to find how many times '123' was duplicated, how many times '234' was duplicated, etc. So ideally, the output would be like:

123  3 
234  2 
345  1

Answer

wonk0 picture wonk0 · Jul 15, 2011

Assuming there is one number per line:

sort <file> | uniq -c

You can use the more verbose --count flag too with the GNU version, e.g., on Linux:

sort <file> | uniq --count

Related questions

Count how many files in directory PHP

I'm working on a slightly new project. I wanted to know how many files are in a certain directory. <div id="header"> <?php $dir = opendir('uploads/'); # This is the directory it will count from $i = 0; # Integer …

Read More
How can I tell how many objects I've stored in an S3 bucket?

Unless I'm missing something, it seems that none of the APIs I've looked at will tell you how many objects are in an <S3 bucket>/<folder>. Is there any way to get a count?

Read More
python - find the occurrence of the word in a file

I am trying to find the count of words that occured in a file. I have a text file (TEST.txt) the content of the file is as follows: ashwin programmer india amith programmer india The result I expect is: { …

Read More