GNU Parallel

Running a script with multiple arguments using GNU parrallel on UNIX.

parallel -j 20 --ungroup python myscript.py {1} ::: val1 val2 val3

Replace 20 by the number of cores to use. --ungroup is used to display the output of the scripts as they come (not grouped by argument). {n} indicates the position of arguments

Grab the HTML from an input list of domains:

parallel --progress --timeout 5 -a top_1k_sans_proto.txt curl -sL {} '>' curl-out/{}.html