Bash Cookbook · 2nd Edition by Vossen, J.P. -- Read -- Imperial Library of Trantor

Index

Preface

Who Should Read This Book About This Book Conventions Used in This Book Using Code Examples O’Reilly Safari We’d Like to Hear from You Acknowledgments

Beginning bash

1.1. Why bash? 1.2. The bash Shell 1.3. Decoding the Prompt 1.4. Showing Where You Are 1.5. Finding and Running Commands 1.6. Getting Information About Files 1.7. Showing All Hidden (Dot) Files in the Current Directory 1.8. Using Shell Quoting 1.9. Using or Replacing Builtins and External Commands 1.10. Determining if You Are Running Interactively 1.11. Setting bash as Your Default Shell 1.12. Keeping bash Updated 1.13. Getting bash for Linux 1.14. Getting bash for xBSD 1.15. Getting bash for macOS 1.16. Getting bash for Unix 1.17. Getting bash for Windows 1.18. Getting bash Without Getting bash 1.19. Learning More About bash Documentation

Standard Output

2.1. Writing Output to the Terminal/Window 2.2. Writing Output but Preserving Spacing 2.3. Writing Output with More Formatting Control 2.4. Writing Output Without the Newline 2.5. Saving Output from a Command 2.6. Saving Output to Other Files 2.7. Saving Output from the ls Command 2.8. Sending Output and Error Messages to Different Files 2.9. Sending Output and Error Messages to the Same File 2.10. Appending Rather than Clobbering Output 2.11. Using Just the Beginning or End of a File 2.12. Skipping a Header in a File 2.13. Throwing Output Away 2.14. Saving or Grouping Output from Several Commands 2.15. Connecting Two Programs by Using Output as Input 2.16. Saving a Copy of Output Even While Using It as Input 2.17. Connecting Two Programs by Using Output as Arguments 2.18. Using Multiple Redirects on One Line 2.19. Saving Output When Redirect Doesn’t Seem to Work 2.20. Swapping STDERR and STDOUT 2.21. Keeping Files Safe from Accidental Overwriting 2.22. Clobbering a File on Purpose

Standard Input

3.1. Getting Input from a File 3.2. Keeping Your Data with Your Script 3.3. Preventing Weird Behavior in a Here-Document 3.4. Indenting Here-Documents 3.5. Getting User Input 3.6. Getting Yes or No Input 3.7. Selecting from a List of Options 3.8. Prompting for a Password

Executing Commands

4.1. Running Any Executable 4.2. Running Several Commands in Sequence 4.3. Running Several Commands All at Once 4.4. Telling Whether a Command Succeeded or Not 4.5. Running a Command Only if Another Command Succeeded 4.6. Using Fewer if Statements 4.7. Running Long Jobs Unattended 4.8. Displaying Error Messages When Failures Occur 4.9. Running Commands from a Variable 4.10. Running All Scripts in a Directory

Basic Scripting: Shell Variables

5.1. Documenting Your Script 5.2. Embedding Documentation in Shell Scripts 5.3. Promoting Script Readability 5.4. Separating Variable Names from Surrounding Text 5.5. Exporting Variables 5.6. Seeing All Variable Values 5.7. Using Parameters in a Shell Script 5.8. Looping Over Arguments Passed to a Script 5.9. Handling Parameters with Spaces 5.10. Handling Lists of Parameters with Spaces 5.11. Counting Arguments 5.12. Consuming Arguments 5.13. Getting Default Values 5.14. Setting Default Values 5.15. Using null as a Valid Default Value 5.16. Using More than Just a Constant String for Default 5.17. Giving an Error Message for Unset Parameters 5.18. Changing Pieces of a String 5.19. Getting the Absolute Value of a Number 5.20. Using bash for basename 5.21. Using bash for dirname 5.22. Using Alternate Values for Comma Separated Values 5.23. Using Array Variables 5.24. Converting Between Upper- and Lowercase 5.25. Converting to Camel Case

Shell Logic and Arithmetic

6.1. Doing Arithmetic in Your Shell Script 6.2. Branching on Conditions 6.3. Testing for File Characteristics 6.4. Testing for More than One Thing 6.5. Testing for String Characteristics 6.6. Testing for Equality 6.7. Testing with Pattern Matches 6.8. Testing with Regular Expressions 6.9. Changing Behavior with Redirections 6.10. Looping for a While 6.11. Looping with a read 6.12. Looping with a Count 6.13. Looping with Floating-Point Values 6.14. Branching Many Ways 6.15. Parsing Command-Line Arguments 6.16. Creating Simple Menus 6.17. Changing the Prompt on Simple Menus 6.18. Creating a Simple RPN Calculator 6.19. Creating a Command-Line Calculator

Intermediate Shell Tools I

7.1. Sifting Through Files for a String 7.2. Getting Just the Filename from a Search 7.3. Getting a Simple True/False from a Search 7.4. Searching for Text While Ignoring Case 7.5. Doing a Search in a Pipeline 7.6. Paring Down What the Search Finds 7.7. Searching with More Complex Patterns 7.8. Searching for an SSN 7.9. Grepping Compressed Files 7.10. Keeping Some Output, Discarding the Rest 7.11. Keeping Only a Portion of a Line of Output 7.12. Reversing the Words on Each Line 7.13. Summing a List of Numbers 7.14. Counting String Values with awk 7.15. Counting String Values with bash 7.16. Showing Data as a Quick and Easy Histogram 7.17. An Easy Histogram with bash 7.18. Showing a Paragraph of Text After a Found Phrase

Intermediate Shell Tools II

8.1. Sorting Your Output 8.2. Sorting Numbers 8.3. Sorting IP Addresses 8.4. Cutting Out Parts of Your Output 8.5. Removing Duplicate Lines 8.6. Compressing Files 8.7. Uncompressing Files 8.8. Checking a tar Archive for Unique Directories 8.9. Translating Characters 8.10. Converting Uppercase to Lowercase 8.11. Converting DOS Files to Linux Format 8.12. Removing Smart Quotes 8.13. Counting Lines, Words, or Characters in a File 8.14. Rewrapping Paragraphs 8.15. Doing More with less

Finding Files: find, locate, slocate

9.1. Finding All Your MP3 Files 9.2. Handling Filenames Containing Odd Characters 9.3. Speeding Up Operations on Found Files 9.4. Finding Files Across Symbolic Links 9.5. Finding Files Irrespective of Case 9.6. Finding Files by Date 9.7. Finding Files by Type 9.8. Finding Files by Size 9.9. Finding Files by Content 9.10. Finding Existing Files and Content Fast 9.11. Finding a File Using a List of Possible Locations

Additional Features for Scripting

10.1. “Daemon-izing” Your Script 10.2. Reusing Code with Includes and Sourcing 10.3. Using Configuration Files in a Script 10.4. Defining Functions 10.5. Using Functions: Parameters and Return Values 10.6. Trapping Interrupts 10.7. Redefining Commands with alias 10.8. Avoiding Aliases and Functions 10.9. Counting Elapsed Time 10.10. Writing Wrappers

Working with Dates and Times

11.1. Formatting Dates for Display 11.2. Supplying a Default Date 11.3. Automating Date Ranges 11.4. Converting Dates and Times to Epoch Seconds 11.5. Converting Epoch Seconds to Dates and Times 11.6. Getting Yesterday or Tomorrow with Perl 11.7. Figuring Out Date and Time Arithmetic 11.8. Handling Time Zones, Daylight Saving Time, and Leap Years 11.9. Using date and cron to Run a Script on the Nth Day 11.10. Logging with Dates

End-User Tasks as Shell Scripts

12.1. Starting Simple by Printing Dashes 12.2. Viewing Photos in an Album 12.3. Loading Your MP3 Player 12.4. Burning a CD 12.5. Comparing Two Documents

Parsing and Similar Tasks

13.1. Parsing Arguments for Your Shell Script 13.2. Parsing Arguments with Your Own Error Messages 13.3. Parsing Some HTML 13.4. Parsing Output into an Array 13.5. Parsing Output with a Function Call 13.6. Parsing Text with a read Statement 13.7. Parsing with read into an Array 13.8. Reading an Entire File 13.9. Getting Your Plurals Right 13.10. Taking It One Character at a Time 13.11. Cleaning Up an SVN Source Tree 13.12. Setting Up a Database with MySQL 13.13. Isolating Specific Fields in Data 13.14. Updating Specific Fields in Datafiles 13.15. Trimming Whitespace 13.16. Compressing Whitespace 13.17. Processing Fixed-Length Records 13.18. Processing Files with No Line Breaks 13.19. Converting a Datafile to CSV 13.20. Parsing a CSV Datafile

Writing Secure Shell Scripts

14.1. Avoiding Common Security Problems 14.2. Avoiding Interpreter Spoofing 14.3. Setting a Secure $PATH 14.4. Clearing All Aliases 14.5. Clearing the Command Hash 14.6. Preventing Core Dumps 14.7. Setting a Secure $IFS 14.8. Setting a Secure umask 14.9. Finding World-Writable Directories in Your $PATH 14.10. Adding the Current Directory to the $PATH 14.11. Using Secure Temporary Files 14.12. Validating Input 14.13. Setting Permissions 14.14. Leaking Passwords into the Process List 14.15. Writing setuid or setgid Scripts 14.16. Restricting Guest Users 14.17. Using chroot Jails 14.18. Running as a Non-root User 14.19. Using sudo More Securely 14.20. Using Passwords in Scripts 14.21. Using SSH Without a Password 14.22. Restricting SSH Commands 14.23. Disconnecting Inactive Sessions

Advanced Scripting

15.1. Finding bash Portably for #! 15.2. Setting a POSIX $PATH 15.3. Developing Portable Shell Scripts 15.4. Testing Scripts Using Virtual Machines 15.5. Using for Loops Portably 15.6. Using echo Portably 15.7. Splitting Output Only When Necessary 15.8. Viewing Output in Hex 15.9. Using bash Net-Redirection 15.10. Finding My IP Address 15.11. Getting Input from Another Machine 15.12. Redirecting Output for the Life of a Script 15.13. Working Around “Argument list too long” Errors 15.14. Logging to syslog from Your Script 15.15. Using logger Correctly 15.16. Sending Email from Your Script 15.17. Automating a Process Using Phases 15.18. Doing Two Things at Once 15.19. Running an SSH command on multiple hosts

Configuring and Customizing bash

16.1. bash Startup Options 16.2. Customizing Your Prompt 16.3. A Prompt Before Your Program Runs 16.4. Changing Your $PATH Permanently 16.5. Changing Your $PATH Temporarily 16.6. Setting Your $CDPATH 16.7. When Programs Are Not Found 16.8. Shortening or Changing Command Names 16.9. Adjusting Shell Behavior and Environment 16.10. Adjusting readline Behavior Using .inputrc 16.11. Keeping a Private Stash of Utilities by Adding ~/bin 16.12. Using Secondary Prompts: $PS2, $PS3, $PS4 16.13. Synchronizing Shell History Between Sessions 16.14. Setting Shell History Options 16.15. Creating a Better cd Command 16.16. Creating and Changing Into a New Directory in One Step 16.17. Getting to the Bottom of Things 16.18. Adding New Features to bash Using Loadable Builtins 16.19. Improving Programmable Completion 16.20. Using Initialization Files Correctly 16.21. Creating Self-Contained, Portable rc Files 16.22. Getting Started with a Custom Configuration

Housekeeping and Administrative Tasks

17.1. Renaming Many Files 17.2. Using GNU Texinfo and info on Linux 17.3. Unzipping Many ZIP Files 17.4. Recovering Disconnected Sessions Using screen 17.5. Sharing a Single bash Session 17.6. Logging an Entire Session or Batch Job 17.7. Clearing the Screen When You Log Out 17.8. Capturing File Metadata for Recovery 17.9. Creating an Index of Many Files 17.10. Using diff and patch 17.11. Counting Differences in Files 17.12. Removing or Renaming Files Named with Special Characters 17.13. Prepending Data to a File 17.14. Editing a File in Place 17.15. Using sudo on a Group of Commands 17.16. Finding Lines That Appear in One File but Not in Another 17.17. Keeping the Most Recent N Objects 17.18. Writing to a Circular Log 17.19. Circular Backups 17.20. Grepping ps Output Without Also Getting the grep Process Itself 17.21. Finding Out Whether a Process Is Running 17.22. Adding a Prefix or Suffix to Output 17.23. Numbering Lines 17.24. Writing Sequences 17.25. Emulating the DOS Pause Command 17.26. Commifying Numbers

Working Faster by Typing Less

18.1. Moving Quickly Among Arbitrary Directories 18.2. Repeating the Last Command 18.3. Running Almost the Same Command 18.4. Quick Substitution 18.5. Reusing Arguments 18.6. Finishing Names for You 18.7. Playing It Safe 18.8. Big Changes, More Lines

Tips and Traps: Common Goofs for Novices

19.1. Forgetting to Set Execute Permissions 19.2. Fixing “No such file or directory” Errors 19.3. Forgetting That the Current Directory Is Not in the $PATH 19.4. Naming Your Script “test” 19.5. Expecting to Change Exported Variables 19.6. Forgetting Quotes Leads to “command not found” on Assignments 19.7. Forgetting that Pattern Matching Alphabetizes 19.8. Forgetting that Pipelines Make Subshells 19.9. Making Your Terminal Sane Again 19.10. Deleting Files Using an Empty Variable 19.11. Seeing Odd Behavior from printf 19.12. Testing bash Script Syntax 19.13. Debugging Scripts 19.14. Avoiding “command not found” When Using Functions 19.15. Confusing Shell Wildcards and Regular Expressions

Reference Lists

bash Invocation Prompt String Customizations ANSI Color Escape Sequences Builtin Commands bash Reserved Words Builtin Shell Variables set Options shopt Options Test Operators I/O Redirection echo Options and Escape Sequences printf Date and Time String Formatting with strftime Pattern-Matching Characters extglob Extended Pattern-Matching Operators tr Escape Sequences readline Init File Syntax Table of ASCII Values

Examples Included with bash

bash Documentation and Examples

Command-Line Processing

Command-Line Processing Steps

Revision Control

Git Bazaar Mercurial Subversion Meld etckeeper Other

Building bash from Source

Obtaining bash Unpacking the Archive What’s in the Archive Who Do I Turn To?

Index

← Prev
Back
Next →

← Prev
Back
Next →