Free Code

Awk: The Secret Weapon for Unix Shell Text Transformation

Awk is a powerful command-line tool that can be used to perform various text manipulation operations in Unix-like operating systems. Here are a few examples of operations that can be performed using awk:

  1. Search and replace: Awk can be used to search for a specific pattern in a file and replace it with another string. For example, to replace all occurrences of “old” with “new” in a file:
awk '{gsub(/old/, "new"); print}' file.txt
  1. Extract specific fields: Awk can be used to extract specific fields from a file. For example, to extract the second field from a file using a comma as a delimiter:
awk -F, '{print $2}' file.txt
  1. Summarizing data: Awk can be used to summarize data by calculating the sum, average, maximum, or minimum of a specific field. For example, to calculate the sum of the second field in a file:
awk '{sum+=$2} END {print sum}' file.txt
  1. Conditional statements: Awk can be used to perform actions based on specific conditions. For example, to print all lines that contain the word “error”
awk '/error/ {print}' file.txt
  1. Built-in variables: Awk provides a number of built-in variables that can be used to perform various operations, such as NR (number of records), NF (number of fields), and $0 (entire line). For example, to print the line number and the first field of a file:
awk '{print NR " " $1}' file.txt
  1. Multiple commands: Awk can be used to execute multiple commands in a single command line. For example, to replace all occurrences of “old” with “new” and print the line number and the entire line:
awk '{gsub(/old/, "new"); print NR " " $0}' file.txt
  1. Arrays: Awk supports arrays, which can be used to store and manipulate data. For example, to store the second field of each line in an array:
awk '{a[NR]=$2} END {for (i in a) print a[i]}' file.txt
  1. User-defined variables: Awk supports user-defined variables, which can be used to store and manipulate data. For example, to create a variable “sum” and increment it for each line:
awk '{sum+=$2} END {print sum}' file.txt
  1. Regular expressions: Awk supports regular expressions, which can be used to match patterns in a file. For example, to print all lines that match a regular expression:
awk '/regex/ {print}' file.txt
  1. Functions: Awk supports user-defined functions, which can be used to perform specific actions. For example, to create a function that takes a parameter and performs an action based on it:
awk 'function my_func(param) {if (param==1) print "hello"; else print "world"} my_func(1)' file.txt

Awk is a very powerful tool and can be used to perform a wide range of text manipulation operations. It’s important to note that awk is a versatile command-line tool that can handle structured data and text processing in a simple, elegant and efficient way.