0

Folks,

I'm trying to use wget to build a list of URLs of a site, and also to check broken links.

Here's my problem: I want wget to check references to external sites, but do not further process those references.

That is, if I'm mapping www.example.com, and any of the pages within that domain contains a reference to a page in a different domain (say "http://example.net/document.html"), I want wget to check that such document exists, but do not process such document any further (i.e., do not follow links within that document).

Any clues how to achieve this?

Thanks! Fernando

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.