Wget with input-file and output-document

bash, wget, xargs

Solution

how about using a loop?

while read -r line
do
   md5=$(echo "$line"|md5sum)
   wget ... $line ... --output-document $md5 ......
done < url-list.txt

Problem

I have a list of URLs which I would like to feed into wget using --input-file. However I can't work out how to control the --output-document value at the same time, which is simple if you issue the commands one by one. I would like to save each document as the MD5 of its URL. ``` cat url-list.txt | xargs -P 4 wget ``` And xargs is there because I also want to make use of the max-procs features for parallel downloads.

Original source