I'm using wget to download some pages and I don't want it to download the same page if it has already been downloaded. I use the following command:
wget --no-clobber --input text04.txt --directory-prefix =/path/file
** the text04.txt file has new links every day that may be the same as in previous days
When downloading the pages they come without the extension (in the case .html). This does not let the file open normally, but if I add the extension after wget downloads when it is executed again, the "--no-clobber" command is useless, since adding the .html is considered by wget with a new file.
Would you like to add the extension (.html) and when the wget is re-executed do not download the same file more than once?