GNU Parallel Ryugu released

From LinuxReviews
Jump to navigationJump to search
Gnu-head.jpg

Ole Tange has released another update to the GNU Parallel command-line utility for spawning multiple jobs in parallel. The new version promises 40% faster start-up on GNU/Linux systems by using a more efficient method of determining the parent shell. There's also bug fixes and manual page updates.

The release comes one month after GNU Parallel "HongKong". As a reminder, GNU Parallel is very useful for spawning a limited number of jobs in parallel when a large number of identical or similar jobs needs to be done. As an example, compressing a large amount of PNG images in a folder can be done with f in *.png;do pngquant ${f};done which would process the images one by one OR one could run parallel -j6 pngquant ::: *.png and execute six jobs in parallel until all the jobs are done. Using GNU Parallel will finish a whole faster on a 6 core system.

Blue-gnu.jpg
GNU Parallel is a GNU project.

A 40% faster start-up time is not the only change in "Ryugu" since "HongKong" was released. There are other high-lights:

  • {= uq; =} causes the replacement string to be unquoted. Example: parallel echo '{=uq;=}.jpg' ::: '*'
  • --tagstring {=...=} is now evaluated for each line with --linebuffer.
  • Use -J ./profile to read a profile in current dir.
  • $PARALLEL_SSHLOGIN can be used in the command line.
  • Small bug-fixes
  • Manual page updates

All the distributions have GNU Parallel in their repositories. That version is probably new enough for your needs. The latest version with 40% faster start-up times can be acquired from http://mirror.clarkson.edu/gnu/parallel/

The parallel manual page is very long but it is worth a look if you want to unleash it's full potential. There is also a book by Parallel's author Ole Tange titled "GNU Parallel 2018" available. It can be read online at zenodo and a paper-back book is current available on sale 50% off at Lulu. Parallel's homepage is at http://www.gnu.org/software/parallel/