Unix uniq, sort & cut command remove duplicate lines

unix sorting command cut uniq
eleven picture eleven · Oct 1, 2012 · Viewed 10.2k times · Source

If we have the following result:

Operating System,50
Operating System,40
Operating System,30
Operating System,23
Data Structure,87
Data Structure,21
Data Structure,17
Data Structure,8
Data Structure,3
Crypo,33
Crypo,31
C++,65
C Language,39
C Language,19
C Language,4
Java 1.6,16
Java 1.6,11
Java 1.6,10
Java 1.6,2

I only want to compare the first field (book name), and remove duplicate lines except the first line of each book, which records the largest number. So the result is as below:

Operating System,50
Data Structure,87
Crypo,33
C++, 65
C Language,39
Java 1.6,16

Can anyone help me out that how could I do using uniq, sort & cut command? May be using tr, head or tail?

Answer

sehe picture sehe · Oct 3, 2012

Most elegant in this case would seem

rev input | uniq -f1 | rev

Related questions

Sorting a tab delimited file

I have a data with the following format: foo<tab>1.00<space>1.33<space>2.00<tab>3 Now I tried to sort the file based on the last field decreasingly. I tried the following commands but …

Read More
Sorting multiple keys with Unix sort

I have potentially large files that need to be sorted by 1-n keys. Some of these keys might be numeric and some of them might not be. This is a fixed-width columnar file so there are no delimiters. Is there …

Read More
Sort CSV file by column priority using the "sort" command

I have a csv file, and I would like to sort it by column priority, like "order by". For example: 3;1;2 1;3;2 1;2;3 2;3;1 2;1;3 3;2;1 If this situation was the result of a "select", the "order by" would be as follows: order by column2, column1, …

Read More