This is sort of a uniq tutorial

[dos2unix]

Using uniq and sort in Linux​

The uniq and sort commands are powerful tools in Linux for processing and organizing text data. They are often used together to remove duplicates and sort data efficiently.

sort Command​

The sort command sorts lines of text files. By default, it sorts in ascending order.

Basic Usage:

 sort filename.txt

Sort in Descending Order:

 sort -r filename.txt

uniq Command​

The uniq command filters out repeated lines in a file. It only removes adjacent duplicate lines, so it is often used with sort.

Basic Usage:

 uniq filename.txt

Count Occurrences:

 uniq -c filename.txt

Combining sort and uniq​

To remove all duplicate lines from a file, you can combine sort and uniq.

Remove Duplicates:

 sort filename.txt | uniq

Count Unique Lines:

 sort filename.txt | uniq -c

Sorting Text with cut or awk​

You can use cut or awk to extract specific columns from a file and then sort them.

Using cut:

 cut -d',' -f2 filename.csv | sort

This command extracts the second column from a CSV file and sorts it.

Using awk:

 awk -F',' '{print $2}' filename.csv | sort

This command does the same as the previous example but uses awk to extract the second column.

Additional Suggestions​

• Sort by Numeric Values:

   sort -n filename.txt

• Sort by Month:

   sort -M filename.txt

• Sort by a Specific Column:

   sort -k 2 filename.txt

• Remove Duplicate Lines and Save to a New File:

   sort filename.txt | uniq > newfile.txt