Take the 2-minute tour ×
Ask Ubuntu is a question and answer site for Ubuntu users and developers. It's 100% free, no registration required.

I want to download entire website. It has a very simple structure, pure HTML+CSS, no CMS or whatever. However, instead of most pages I get the same 31byte file, with a string "Requested range not satisfiable" I run wget as following:

wget -m -p -k -U Mozilla http://address

What options can I try?

share|improve this question

closed as too localized by Marco Ceppi Jan 24 '12 at 16:03

This question is unlikely to help any future visitors; it is only relevant to a small geographic area, a specific moment in time, or an extraordinarily narrow situation that is not generally applicable to the worldwide audience of the internet. For help making this question more broadly applicable, visit the help center.If this question can be reworded to fit the rules in the help center, please edit the question.

    
Site works well in Firefox. –  Barafu Albino May 31 '11 at 18:58
    
Guys, I can Google. Found nothing. –  Barafu Albino Jun 1 '11 at 12:09
    
I don't experience your problem. Can you give an example site? –  djeikyb Aug 17 '11 at 20:33
    
Yes, if you can find a specific web address that reproduces the problem, that would help people troubleshoot this. Also, you can use underthesite.com to find out if the website "really" is just html+css. –  Angelo Jan 18 '12 at 21:45
    
This question appears to be abandoned, if you are experiencing a similar issue please ask a new question with details pertaining to your problem. If you feel this question is not abandoned, please flag the question explaining that. :) –  jrg Jan 24 '12 at 14:00

4 Answers 4

wget is one possibility to mirror a website, another one is httrack. Maybe you can give a try.

share|improve this answer
    
Thanks, but, in future, I intend to automate the process and include it as a plugin into another software. httrack is too hard to install for this, as many distributions has no such package in repo. –  Barafu Albino Jun 1 '11 at 12:07
    
please explain more –  user61928 Oct 2 '12 at 4:57

That error means

416 Requested Range Not Satisfiable
The client has asked for a portion of the file, but the server cannot supply that portion.[2] For example, if the client asked for a part of the file that lies beyond the end of the file.

This is taken from http://en.wikipedia.org/wiki/List_of_HTTP_status_codes

Some sites also block the use of robots using robots.txt. More info here - http://en.wikipedia.org/wiki/Robots_exclusion_standard

Also as @sh4d0w mentioned httrack, here is the link for it - http://www.httrack.com/

share|improve this answer
    
What is your advice? What did you mean by this? –  Barafu Albino Jun 1 '11 at 12:08
    
The error means what I put in the quote section and robots.txt, please read up on the link. Try httrack.com as sh4d0w suggested. –  nitstorm Jun 1 '11 at 12:55
    
-1, The OP wants to understand WHY his wget command isn't working so that he can correct it. In this case, the 416 error code message doesn't shed any light on the matter (at least not directly). The wget command looks "OK", I am baffled too. –  Angelo Jan 18 '12 at 21:37
    
@Angelo I think the code message definitely makes atleast some sense, coz the OP wants to know why he is unable to download the page. The site may have something to redirect robots or be configured to give them an error like this. Downloading sites via wget is considered as a robot as long as the site is concerned. Also there is the possibility that the OP is requesting for a part of the file that he needs to download that needs authentication. Plus the exact address of the site isn't given so makes it tougher to see the problem. Hope that justified why I answered like this. –  nitstorm Jan 19 '12 at 4:17

to download an entire website this is the command i use with wget:

wget -r http://www.youtube.com/

this download every page on www.youtube.com en the subdirectories youtube.com/?/?/?/?/ this usually works for me.

share|improve this answer
wget \
 --recursive \
 --no-clobber \
 --page-requisites \
 --html-extension \
 --convert-links \
 --restrict-file-names=windows \
 --domains website.org \
 --no-parent \
     www.website.org/tutorials/html/

The options are:

--recursive: download the entire Web site.

--domains website.org: don't follow links outside website.org.

--no-parent: don't follow links outside the directory tutorials/html/.

--page-requisites: get all the elements that compose the page (images, CSS and so on).

--html-extension: save files with the .html extension.

--convert-links: convert links so that they work locally, off-line.

--restrict-file-names=windows: modify filenames so that they will work in Windows as well.

--no-clobber: don't overwrite any existing files (used in case the download is interrupted and
resumed).
share|improve this answer
    
I have seen website you copied it from. Didn't help. –  Barafu Albino Jun 1 '11 at 12:04

Not the answer you're looking for? Browse other questions tagged or ask your own question.