Take the 2-minute tour ×
Ask Ubuntu is a question and answer site for Ubuntu users and developers. It's 100% free, no registration required.

I need to download an FTP site (a web site source code actually) containing a very high quantity of relatively small files (downloading it with FileZilla took more than a day, but I believe it could be downloaded much faster if many files were downloaded at once). Unfortunately there is no SSH access to the site and no way to archive the files on the server side.

So at least the question is how to download a whole FTP site into a folder using command line tools. A better it'd be if the download could be parallelized by downloading many files simultaneously instead of one by one.

share|improve this question

1 Answer 1

up vote 11 down vote accepted

Try the following:

wget -r ftp://username:password@myserver.com

this will go to 5 depth levels; to increase, add the -l option

Some servers don't like this behavior, and you risk getting blacklisted because of the load on the server. To avoid this, use the -w option to wait a specified number of seconds.

More info (as well as caveats) can be found here:

http://www.gnu.org/software/wget/manual/wget.html#Recursive-Download

http://linuxreviews.org/quicktips/wget/

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.