GNU Wget (or just wget) is a command line-based program for downloading content from the Internet using HTTP, HTTPS and FTP.

learn more… | top users | synonyms

-5
votes
0answers
35 views

can someone explain this bin.sh shell script for me? [on hold]

Can someone please explain this shell script that was detected from my honeypot? #!/bin/bash busybox rm -rf /tmp/* busybox rm -rf /usr/bin/strings busybox rm -rf /usr/bin/ps busybox wget ...
1
vote
1answer
33 views

downloads file in parallel [duplicate]

I have list of url(near about 50k) of images in text file which I want to download. Is there anyway I can download it in async way using wget command or any other way, by reading it from text file.
-1
votes
1answer
40 views

I'm not able to upgrade NodeJS on Ubuntu 14.04

I'm currently using Ubuntu 14.04 LTS, and I installed NodeJS 0.10. I am now trying to upgrade to version 5 of NodeJS. I used the commands below to upgrade: wget -qO- ...
0
votes
0answers
30 views

Download a Specify repository from Windows. [Help!!]

I decided from now start with the world of Linux. Honestly, I do not have access to the Internet to use it all the time. That is why, I need to make a mirror of a repository, then take it with me on ...
0
votes
1answer
30 views

Getting “Scheme missing” error with wget

I wrote a little script that grabs a random wallpaper from the Desktoppr API and changes my desktop wallpaper to it: #!/bin/bash url=$(curl 'https://api.desktoppr.co/1/wallpapers?page='$(shuf -i ...
1
vote
1answer
35 views

wget to get a file generated by a php script

I am trying to get a file generated by the php script export.php. But using this command, I am either getting 403 Request Forbidden or downloading the script itself instead of a .csv the script is ...
0
votes
1answer
21 views

Images from Webpages in Ubuntu 14.04

I m trying to download images from webpage using wget package in terminal but its not working correctly. I want all my images to get saved in a folder. But its not working. The command I m using is: ...
0
votes
3answers
69 views

how to search file using wget or curl on server?

I know wget utility which retrieves files from World Wide Web (WWW) like wget http://ftp.gnu.org/gnu/wget/wget-1.5.3.tar.gz But my confusion is how can i find content in directory on server without ...
4
votes
2answers
67 views

Download executable script from GitHub preserving +x permissions

I want to make a GitHub repository of all relevant scripts I posted here as answers. But to keep it ultimately simple for the users, I would like to give them a single command to download the script ...
0
votes
0answers
38 views

Can't “wget” a link after passing a captcha

Normally, after passing the captcha, I can copy&paste the link of the protected resource (e.g. video) and download with "wget" on the terminal. Sth. weird happens to this website: (download raw ...
0
votes
0answers
10 views

Download old hamachi version

I'm trying to download an older version of hamachi for our ubuntu server. The version I'm trying to download is Hamachi version 2.1.0.296. I usually download it by wget but when i tried to modify it ...
0
votes
0answers
16 views

configure apache to support wget/wput with authentication

I have a stardard apache web server running on Amazon AWS ubuntu 14.10 with my company site pages. Very simple and standard. I´ve used a framework and PHP for page handling. I have client machines ...
0
votes
1answer
62 views

No certificate files inside of /usr/lib/ssl

I don't appear to have any SSL certs installed on my machine and it is causing issues with wget and Faraday called within Rails. When I run openssl version -a I am told my OPENSSLDIR is ...
0
votes
0answers
10 views

Wget and Grabitshare direct download to ubuntu server

I am sorry if this was asked before, but i yust cant figure this out... I have a premium acc on grabitshare and i have a direct link to a video file : ...
0
votes
0answers
10 views

wget user authentication with public/private keys

I want to set up wget (version 1.13.4, but I can upgrade if I have to) to allow me to login with a username to a site but use a pre-established public/private keypair a la ssh to connect. I do not ...
1
vote
1answer
37 views

wget downloads in a loop

I am trying to download some files using: $ for i in `seq 1234 1250`; do torify wget -A.mp4 http://www.my_example.com/video.php?id=$i&dl=1 done Clearly these all downloads will be ...
0
votes
0answers
34 views

wget changes Excel file size

I'm using wget to download Excel file with xlsx extension. The thing is that when I want to deal with the file using openpyxl, I get the following error "BadZipfile: File is not a zip file". But when ...
0
votes
3answers
85 views

Cannot download file using wget

So i am reading The Official Ubuntu Server Book and i just got to the part where i make a pxe boot server. Everything looks good till i am supposed to download some files using wget. The url i entered ...
0
votes
1answer
95 views

wget web crawler retrieves unwanted index.html index files

I made a ~/.bashrc function to save some web directories into my local disk. It works well except some unwanted index files that is not present in the website. I use it like crwl ...
-3
votes
2answers
90 views

Parsing downloaded HTML

I would like to download a HTML file from a website using wget then search through the file for a specific line and wget that link. example: wget example.com/whatever.html The output of that html ...
3
votes
1answer
84 views

How do I extract test line by line from a text file in terminal?

So I have a .sh script that needs to wget a lot of files. I have a text file set up like this http://www.website.com/w4w4wbvert9rtr/video.mp4 http://www.website.com/wserteg444gs4r/video.mp4 ...
4
votes
2answers
279 views

One single cron job not running

I have a list of cron jobs. 00 21 * * * sh ~/db_backup.sh 20 21 * * * sh ~/update.sh * 5 1 * * sh ~/db_vacuum.sh The first job makes a backup of a database I have running on an Ubuntu server, ...
1
vote
0answers
113 views

Wget giving 403 error

I am trying to download a mp4 file from www.dayt.se. I used Inspect Element feature of Chrome to get the url of the video file. I can download the file with that URL on Chrome. But I get the 403 ...
0
votes
0answers
28 views

Bruteforce download and convert images

So, I'm basically trying to bruteforce download from a server that doesn't seem to support directory listing or FTP. I know the image files are all png and have numeric filenames ranging from 0-500. ...
1
vote
1answer
36 views

How do you mirror an archive with wget?

I would like to mirror an HTTP directory into a local folder with wget. I've tried a number of methods online which all seem to not be working. My test site is the Ubuntu repositories ...
0
votes
0answers
25 views

Issue running wget

I'm running Ubuntu 12.04 on my machine and I use zsh as my primary shell. Within zsh if I run wget <link> , it throws zsh: permission denied: wget as an error. Trying the same command with sudo ...
0
votes
2answers
78 views

Convert whole Website in book or pdf format

Is there any way that I can download whole website content in book/pdf or any printable format. This is the website which I want to convert to pdf ...
2
votes
1answer
262 views

wget, curl HTTP addresses fail, HTTPS work, ping works [closed]

I am running Ubuntu Server 14.04.2, and I can't communicate with external http addresses anymore. I can ping google.com, I can wget https://google.com, but I can't wget http://google.com. $ wget ...
0
votes
1answer
386 views

How to solve “wget: unable to resolve host address” [closed]

I am running this as root: # wget http://prdownloads.sourceforge.net/sourceforge/nagios/nagios-4.0.1.tar.gz --2015-11-17 20:31:46-- ...
0
votes
1answer
42 views

Wget large file ends up 503

I'm trying to download a large file 10gb backup file from bluehost cpanel based account. When i: wget -c http://domain.com/backup.zip I get: HTTP request sent, awaiting response... 503 Service ...
0
votes
1answer
24 views

Download backup to ubuntu

I had my site on bluehost now moved to vps running ubuntu I made the backup of my site on bluehost and saved it in public_html directory with permission 755 Now when i try: wget ...
0
votes
0answers
154 views

How can I download a private bitbucket repo using curl or wget?

I have an account on Bitbucket, I want to download a private repo but I'm not using client like web Browser but using terminal clients like 'curl' and or 'wget'. I want to download a private bitbucket ...
0
votes
0answers
56 views

Ubuntu 14.04 cannot browse, wget and curl https sites. Http works fine

Ubuntu 14.04 cannot browse, wget and curl https sites. Http works fine. What is the problem here? curl http://cisco.internect.net/weather.php Enter your Postcode eg: Canberra: 2600, Sydney: 2000 ...
0
votes
0answers
21 views

how to resume a wget -r download?

I am aware of the questions here that ask how to resume a wget download, which is simply a wget with the -c argument. My question is how can I resume a recursive wget download (ran using the -r ...
0
votes
1answer
55 views

Cannot install WGET in Ubuntu 12.04.1 lts [closed]

When installing wget through terminal it displays following error .I went through questions earlier asked on this topic and so I had added the results of echo $PATH and cat ~/.pam_environmententer ...
1
vote
1answer
15 views

Launch a codeblock in “screen”

I'm working on a script that downloads large files like installers, youtube video series or torrents. It's supposed to work on a Raspbian. So the main part has to be delt with in a screen session. Or ...
12
votes
2answers
2k views

Get all image files with wget

I am trying to download all the image file is a folder. I tried wget -r https://example.com/ And wget https://example.com/*.jpg These didn't work. Can anyone guide?
1
vote
1answer
318 views

wget and cURL not working with bash script

I am trying to download an images off a website and have tried: curl -o img.jpg (URL) wget (URL) -O img.jpg wget --save-headers -U "Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/534.17 (KHTML, ...
0
votes
1answer
83 views

MAAS Failed deploying Connection refused when downloading root-tgz

I have a problem with MAAS node deployment. I commission the node and it all goes well, node shuts down and node is in ready status. I start the node it goes to Deploying state and when it starts to ...
0
votes
1answer
74 views

Need help with this shell script getting syntax error

I would like this to search for a file and if it's over 250M then download it. If not do not download it. echo "Name your file." read echo "Paste the url you wish to check below." read url if (( wget ...
1
vote
2answers
120 views

Wget: download files to specific directory

I have been trying to get wget to download all files to a specific directory. I tried the -O option but I get /home/user/xml/: Is a directory This is what I have so far wget -m --user=user ...
23
votes
4answers
6k views

What is the difference between curl and wget? [closed]

Both of these curl and wget are use for downloading files, etc. Is there any reason to use one over the other?
0
votes
2answers
51 views

Understanding a complex wget command

I was just going through a tutorial online HERE. If you see the last command in the section: # For workshops at conferences and events: # Download and install from ...
3
votes
2answers
1k views

what does wget -qO- 127.0.0.1 mean?

I have tried googling for an answer for an hour now and still no luck. Does anyone know what this command mean? wget -qO- 127.0.0.1 I know wget is the Linux "web get" utility, and 127.0.0.1 is ...
2
votes
1answer
159 views

using wget to download xml for conky script won't keep html tags

So I'm trying to setup a conkyrc for weather, using the following script: #!/bin/bash station="KRAP.xml" wdir='/tmp/weather' update_xml() { if [ ! -e "$station" ]; then ...
1
vote
1answer
1k views

SSL3_GET_RECORD:decryption failed or bad record mac

On my up-to-date 15.04 VV Ubuntu boxes, I tried to download some VMs. wget -c https://az412801.vo.msecnd.net/vhd/VMBuild_20141027/VirtualBox/IE8/Linux/IE8.Win7.For.Linux.VirtualBox.zip --2015-07-31 ...
0
votes
2answers
144 views

Wget from webpage in html to many text files

To download all the page one level below superSite.com I do: wget -r -l1 http:/superSite.com But these pages are saved in the .html format. How can I have them be saved in .txt format? (I need to ...
0
votes
1answer
33 views

no reply from server

wget http://10.254.5.225:8080/debs/amd64/google-chrome-stable_current_amd64.deb --2015-07-22 12:59:56-- http://10.254.5.225:8080/debs/amd64/google-chrome-stable_current_amd64.deb Connecting to ...
2
votes
1answer
116 views

parse webpage upto n levels using wget

I am trying to extract URLS from a webpage up to user defined n levels using wget. I tried this wget -r -l$2 --reject=gif -O out.html www.google.com | sed -n 's/.*href="\([^"]*\).*/\1/p'` " It is ...
2
votes
2answers
126 views

can you schedule the start and stop time of copying in wget?

Hi there I'm new here in the forum and very new using tools for Linux. Actually I'm tasked to learn about wget. I already know a few though I'm trying to find out if there is a syntax to use to ...