GNU Wget (or just wget) is a command line-based program for downloading content from the Internet using HTTP, HTTPS and FTP.

learn more… | top users | synonyms

1
vote
1answer
17 views

wget downloads in a loop

I am trying to download some files using: $ for i in `seq 1234 1250`; do torify wget -A.mp4 http://www.my_example.com/video.php?id=$i&dl=1 done Clearly these all downloads will be ...
0
votes
0answers
25 views

wget changes Excel file size

I'm using wget to download Excel file with xlsx extension. The thing is that when I want to deal with the file using openpyxl, I get the following error "BadZipfile: File is not a zip file". But when ...
0
votes
3answers
51 views

Cannot download file using wget

So i am reading The Official Ubuntu Server Book and i just got to the part where i make a pxe boot server. Everything looks good till i am supposed to download some files using wget. The url i entered ...
0
votes
1answer
48 views

wget web crawler retrieves unwanted index.html index files

I made a ~/.bashrc function to save some web directories into my local disk. It works well except some unwanted index files that is not present in the website. I use it like crwl ...
-3
votes
2answers
68 views

Parsing downloaded HTML

I would like to download a HTML file from a website using wget then search through the file for a specific line and wget that link. example: wget example.com/whatever.html The output of that html ...
3
votes
1answer
51 views

How do I extract test line by line from a text file in terminal?

So I have a .sh script that needs to wget a lot of files. I have a text file set up like this http://www.website.com/w4w4wbvert9rtr/video.mp4 http://www.website.com/wserteg444gs4r/video.mp4 ...
4
votes
2answers
173 views

One single cron job not running

I have a list of cron jobs. 00 21 * * * sh ~/db_backup.sh 20 21 * * * sh ~/update.sh * 5 1 * * sh ~/db_vacuum.sh The first job makes a backup of a database I have running on an Ubuntu server, ...
1
vote
0answers
62 views

Wget giving 403 error

I am trying to download a mp4 file from www.dayt.se. I used Inspect Element feature of Chrome to get the url of the video file. I can download the file with that URL on Chrome. But I get the 403 ...
0
votes
0answers
25 views

Bruteforce download and convert images

So, I'm basically trying to bruteforce download from a server that doesn't seem to support directory listing or FTP. I know the image files are all png and have numeric filenames ranging from 0-500. ...
1
vote
1answer
27 views

How do you mirror an archive with wget?

I would like to mirror an HTTP directory into a local folder with wget. I've tried a number of methods online which all seem to not be working. My test site is the Ubuntu repositories ...
0
votes
0answers
22 views

Issue running wget

I'm running Ubuntu 12.04 on my machine and I use zsh as my primary shell. Within zsh if I run wget <link> , it throws zsh: permission denied: wget as an error. Trying the same command with sudo ...
0
votes
2answers
52 views

Convert whole Website in book or pdf format

Is there any way that I can download whole website content in book/pdf or any printable format. This is the website which I want to convert to pdf ...
2
votes
1answer
130 views

wget, curl HTTP addresses fail, HTTPS work, ping works [closed]

I am running Ubuntu Server 14.04.2, and I can't communicate with external http addresses anymore. I can ping google.com, I can wget https://google.com, but I can't wget http://google.com. $ wget ...
0
votes
1answer
237 views

How to solve “wget: unable to resolve host address” [closed]

I am running this as root: # wget http://prdownloads.sourceforge.net/sourceforge/nagios/nagios-4.0.1.tar.gz --2015-11-17 20:31:46-- ...
0
votes
1answer
33 views

Wget large file ends up 503

I'm trying to download a large file 10gb backup file from bluehost cpanel based account. When i: wget -c http://domain.com/backup.zip I get: HTTP request sent, awaiting response... 503 Service ...
0
votes
1answer
16 views

Download backup to ubuntu

I had my site on bluehost now moved to vps running ubuntu I made the backup of my site on bluehost and saved it in public_html directory with permission 755 Now when i try: wget ...
0
votes
0answers
86 views

How can I download a private bitbucket repo using curl or wget?

I have an account on Bitbucket, I want to download a private repo but I'm not using client like web Browser but using terminal clients like 'curl' and or 'wget'. I want to download a private bitbucket ...
0
votes
0answers
40 views

Ubuntu 14.04 cannot browse, wget and curl https sites. Http works fine

Ubuntu 14.04 cannot browse, wget and curl https sites. Http works fine. What is the problem here? curl http://cisco.internect.net/weather.php Enter your Postcode eg: Canberra: 2600, Sydney: 2000 ...
0
votes
0answers
17 views

how to resume a wget -r download?

I am aware of the questions here that ask how to resume a wget download, which is simply a wget with the -c argument. My question is how can I resume a recursive wget download (ran using the -r ...
0
votes
1answer
45 views

Cannot install WGET in Ubuntu 12.04.1 lts [closed]

When installing wget through terminal it displays following error .I went through questions earlier asked on this topic and so I had added the results of echo $PATH and cat ~/.pam_environmententer ...
1
vote
1answer
13 views

Launch a codeblock in “screen”

I'm working on a script that downloads large files like installers, youtube video series or torrents. It's supposed to work on a Raspbian. So the main part has to be delt with in a screen session. Or ...
12
votes
2answers
709 views

Get all image files with wget

I am trying to download all the image file is a folder. I tried wget -r https://example.com/ And wget https://example.com/*.jpg These didn't work. Can anyone guide?
1
vote
1answer
195 views

wget and cURL not working with bash script

I am trying to download an images off a website and have tried: curl -o img.jpg (URL) wget (URL) -O img.jpg wget --save-headers -U "Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/534.17 (KHTML, ...
0
votes
1answer
61 views

MAAS Failed deploying Connection refused when downloading root-tgz

I have a problem with MAAS node deployment. I commission the node and it all goes well, node shuts down and node is in ready status. I start the node it goes to Deploying state and when it starts to ...
0
votes
1answer
63 views

Need help with this shell script getting syntax error

I would like this to search for a file and if it's over 250M then download it. If not do not download it. echo "Name your file." read echo "Paste the url you wish to check below." read url if (( wget ...
1
vote
2answers
59 views

Wget: download files to specific directory

I have been trying to get wget to download all files to a specific directory. I tried the -O option but I get /home/user/xml/: Is a directory This is what I have so far wget -m --user=user ...
22
votes
4answers
3k views

What is the difference between curl and wget? [closed]

Both of these curl and wget are use for downloading files, etc. Is there any reason to use one over the other?
0
votes
2answers
45 views

Understanding a complex wget command

I was just going through a tutorial online HERE. If you see the last command in the section: # For workshops at conferences and events: # Download and install from ...
3
votes
2answers
793 views

what does wget -qO- 127.0.0.1 mean?

I have tried googling for an answer for an hour now and still no luck. Does anyone know what this command mean? wget -qO- 127.0.0.1 I know wget is the Linux "web get" utility, and 127.0.0.1 is ...
2
votes
1answer
123 views

using wget to download xml for conky script won't keep html tags

So I'm trying to setup a conkyrc for weather, using the following script: #!/bin/bash station="KRAP.xml" wdir='/tmp/weather' update_xml() { if [ ! -e "$station" ]; then ...
1
vote
1answer
673 views

SSL3_GET_RECORD:decryption failed or bad record mac

On my up-to-date 15.04 VV Ubuntu boxes, I tried to download some VMs. wget -c https://az412801.vo.msecnd.net/vhd/VMBuild_20141027/VirtualBox/IE8/Linux/IE8.Win7.For.Linux.VirtualBox.zip --2015-07-31 ...
0
votes
2answers
94 views

Wget from webpage in html to many text files

To download all the page one level below superSite.com I do: wget -r -l1 http:/superSite.com But these pages are saved in the .html format. How can I have them be saved in .txt format? (I need to ...
0
votes
1answer
33 views

no reply from server

wget http://10.254.5.225:8080/debs/amd64/google-chrome-stable_current_amd64.deb --2015-07-22 12:59:56-- http://10.254.5.225:8080/debs/amd64/google-chrome-stable_current_amd64.deb Connecting to ...
2
votes
1answer
99 views

parse webpage upto n levels using wget

I am trying to extract URLS from a webpage up to user defined n levels using wget. I tried this wget -r -l$2 --reject=gif -O out.html www.google.com | sed -n 's/.*href="\([^"]*\).*/\1/p'` " It is ...
2
votes
2answers
92 views

can you schedule the start and stop time of copying in wget?

Hi there I'm new here in the forum and very new using tools for Linux. Actually I'm tasked to learn about wget. I already know a few though I'm trying to find out if there is a syntax to use to ...
-1
votes
1answer
112 views

Which is the best way to install aircrack-ng suit [closed]

I have seen two ways to install aircrack-ng in ubuntu Way 1: installing -build-essential,libssl-dev,...,make,make install Way 2: sudo apt-get install aircrack-ng Which of the ways to prefer and ...
2
votes
4answers
893 views

Download all media files from webpage

How to download all media files(pictures + Videos) from a webpage?! Any app is acceptable but wget is preferable
0
votes
0answers
169 views

How to install python-dev - without using apt-get - on ubuntu 12?

The question is pretty descriptive as it's noted. I'm at a working environment that I have not much access over. I have wget and curl, but I can't find any resources.
1
vote
1answer
690 views

wget: unable to resolve host address ‘sudo’ [closed]

I'm new to these stuffs so I am asking this question. I'm trying to install Java v6 from terminal but I'm getting a couple of errors like: --2015-06-29 15:52:31-- http://sudo/ Resolving sudo ...
0
votes
1answer
79 views

Click every link on multiple webpages

In our project we have pages like http://123.4.5.6/3/4; inside there are a few pages. I need to access the URLs and to click on every link within them to download some files (in an automated way). ...
0
votes
1answer
121 views

Using wget with Streamcloud and pages where you have to wait

I'm new to bash scripting and as I heard of "wget" I decided to write a script to download just the .mp4 file from a streamcloud (or whatever) link. I use it normally like: wget -q -O - ...
1
vote
2answers
161 views

Does wget or any other http file downloader on Ubuntu support wild cards?

I would like to be able to write a bash script to automatically update my MediaWiki extensions and I think I will use this website https://extdist.wmflabs.org/dist/extensions/ to do so. But as you can ...
1
vote
1answer
160 views

wget not getting full directory listing

I've hunted high and low and have not been able to find an answer to my problem. I'm not sure if this is the proper forum, but I hope someone here might be able to help. I have been using wget (FTP) ...
2
votes
1answer
38 views

Why is wget not calling my entire web address?

I have a test script with the command: wget ...
0
votes
1answer
227 views

Extract all files from a .tar.gz after wget and rename them

Is there any easy way extract all files from a .tar.gz and rename the files upon extraction? The tars inside look like: file1.obj file2.xr file3.ty file4.hjg All files are different extensions, but ...
1
vote
1answer
77 views

wget not properly downloading file to directory location

I have the command wget -nd -P /2011/ http://water.weather.gov/precip/p_download_new/2011/12/30/nws_precip_1day_observed_shape_20111230.tar.gz -O 20111230.tar.gz The plan is to store the data in ...
1
vote
3answers
93 views

Specify directory that wget downloads to

How can I specify the directory that wget should download all files to? To get an idea I'm currently running the script: wget -r --no-parent --reject "index.html*" ...
2
votes
1answer
1k views

Missing certificate GeoTrust DV SSL CA - G4

Got a new certificate, but wget and curl are not connecting anymore: wget https://MYDOMAIN ERROR: cannot verify MYDOMAINS's certificate, issued by ‘/C=US/O=GeoTrust Inc./OU=Domain Validated ...
0
votes
0answers
314 views

Wget and delete file on url

Please assist. I need to know how to go about getting a file from my url and then deleting that file from the server. More detail. My script will do a wget from my server and put the file locally ...
0
votes
2answers
151 views

wget 200 Webcat Access denied error

I am trying to download this file from terminal but getting following error sudo wget "http://indiamp3download.com/indian_movies/Gangs_Of_Wasseypur_(2012)_IndiaMp3.Com.zip" ...