I'm running a command:
cat urls.txt | xargs -L 1 -P 5 timeout 40 wget
This downloads all the URLs in urls.txt
This used to work fine, but recently I changed the URLs I am downloading from something like: domain.com/54f-5g4/ to something like domain.com/this-that/
And for some reason I am now getting:
cat: write error: Broken pipe
I've looked at the commands being executed and they all look fine, i.e. no unescaped characters.
Does anyone have any idea what the problem may be? Or how to get more debugging information? I believe the problem is with commands after the pipe.
Update: I found the error. It looks like I accidently typed a ' in my urls.txt file. If you are getting this error, you have a problem with your command after the pipe.
urls.txt
file; well you can simply usewget -i urls.txt
:)