Master the Linux Command Line: Essential Tips and Tricks for Power Users

Introduction

Proficiency with the command line dramatically improves an engineer's flexibility and productivity. This article compiles a curated list of essential Linux command‑line techniques, ranging from beginner‑friendly basics to advanced, sometimes obscure, tricks.

Basics

Read the Bash manual with man bash and explore built‑in commands using type , help , or help -d .

Redirect output with > , >> , and pipelines using | . Understand the difference between overwriting ( > ) and appending ( >> ).

Use wildcards like * , ? , [...] , and quoting rules ( ' , " ) to match files and arguments.

Manage jobs with & , ctrl‑z , jobs , fg , bg , and kill .

Connect to remote hosts via ssh , and set up password‑less authentication with ssh‑agent and ssh‑add .

Everyday Usage

Tab completion and command history search with Tab and ctrl‑r . Use ctrl‑w , ctrl‑u , alt‑b , alt‑f , ctrl‑a , ctrl‑e , ctrl‑k , ctrl‑l for efficient editing.

Switch between vi and emacs keymaps with set -o vi or set -o emacs .

Quickly edit long commands using export EDITOR=vim and ctrl‑x ctrl‑e .

Reuse previous commands with history , !n , !$ , and !! .

File and Data Processing

Search files: find . -iname '*pattern*' , locate pattern (requires updatedb ).

Search source code with ag (faster than grep -r ).

Convert HTML to plain text: lynx -dump -stdin . Convert between markup formats with pandoc .

Process JSON ( jq ), YAML ( shyaml ), CSV ( csvkit ), and XML ( xmlstarlet ).

Manipulate files: ls , ls -l , less , head , tail , ln , chmod , chown , du , df , mount , fdisk , mkfs , lsblk .

Use sort , uniq , comm , cut , paste , join , awk , sed for text manipulation.

Change file permissions with chmod , set immutable flag with chattr +i , and manage ACLs with getfacl / setfacl .

Create empty files efficiently using truncate , fallocate , or mkfile .

System Debugging

Network diagnostics: curl , wget , httpie , netstat , ss , mtr , iftop , nethogs .

Resource monitoring: top / htop , iostat , iotop , dstat , glances , free , vmstat , mpstat , sar .

Process inspection: ps , pstree , pgrep / pkill , strace , ltrace , gdb , lsof , lsof | grep deleted .

Kernel and system info via /proc files ( /proc/cpuinfo , /proc/meminfo , etc.) and uname -a , lsb_release -a .

Performance profiling with perf , stap , sysdig , and Java tools ( jps , jstack , jstat , jmap ).

One‑Liners

Set operations on sorted files: sort a b | uniq > c (union), sort a b | uniq -d > c (intersection), sort a b b | uniq -u > c (difference).

Count occurrences of a field: awk '{x+=$3} END {print x}' file .

Extract and count URL parameters: egrep -o 'acct_id=[0-9]+' access.log | cut -d= -f2 | sort | uniq -c | sort -rn .

Monitor directory changes: watch -d -n 2 'ls -rtlh | tail' or watch -d -n 2 ifconfig .

Less‑Known but Useful Tools

Text utilities: expr , m4 , yes , cal , env , printenv , look , fmt , pr , fold , column , expand / unexpand , nl , seq , bc , factor , gpg , toe , nc , socat , slurm , dd , file , tree , stat , time , timeout , lockfile , logrotate , watch , when‑changed , tac , shuf , comm , strings , tr , iconv / uconv , split / csplit , sponge , units , apg , xz , nm , ab / wrk , cssh , rsync , wireshark / tshark , ngrep , host / dig , lsof , ifconfig , last , w , id , sar , ifconfig , sysctl , hdparm , lsblk , lshw / lscpu / lspci / lsusb / dmidecode , lsmod / modinfo , fortune , ddate , sl .

OS‑Specific Sections

macOS

Package management with brew or port . Clipboard utilities pbcopy / pbpaste . Open files with open . Use mdfind and mdls for Spotlight searches. Be aware of BSD‑style command differences.

Windows

Install Unix tools via Cygwin, Bash on Ubuntu on Windows, or MinGW/MSYS. Native Windows utilities include wmic , ping , ipconfig , tracert , netstat , Rundll32 , wmic for scripting, and cygstart , regtool , cygpath for Cygwin integration.

Additional Resources

awesome‑shell : curated list of command‑line tools.

awesome‑osx‑command‑line : deeper macOS guide.

Strict mode and shellcheck : best practices for safe scripting.

Data Science at the Command Line : command‑line tools for data analysis.

Disclaimer

While many clever Bash tricks exist, use them responsibly; code should remain readable and maintainable for others.