Questions tagged [wget]

GNU Wget (or just wget) is a command line-based program for downloading content from the Internet using HTTP, HTTPS and FTP.

Filter by
Sorted by
Tagged with
0
votes
2answers
154 views

bash - Unexcepted Token

I'm writing a bash script to automatize my downloading process. In a section, it gaves a error: syntax error near unexpected token `newURL=$(echo $URL | sed 's/&:/$index/')' That section of ...
0
votes
1answer
77 views

Bash script to download any new version of a file from a webpage of a particular software

Let's say I'm creating a script to automate downloading & compiling Nginx from source but one improvement I would like to make is make sure the script would work with new Nginx versions without me ...
0
votes
0answers
119 views

Downloading multiple files that have their URLs stored in a file but with wildcards inside the file using wget

I have to download multiple log files from an internet page but only the files that have a specific name that I have on my file: In my file called "net" I have the following names but not the address ...
-4
votes
1answer
688 views

Proxy authentication using wget on cygwin [closed]

This question was also posted on SO. My institute recently installed a new proxy server for our network. I am trying to configure my Cygwin environment to be able to run wget and download data from a ...
1
vote
1answer
623 views

wget of redis is not working in docker container with Debian 9 on Ubuntu host

I have a very simple Docker file FROM openjdk:11 ENTRYPOINT ["/bin/bash"] And I have 2 machines with Ubuntu. First machine: Ubuntu 18.04.1, Docker version 18.06.0-ce, build 0ffa825 In the docker ...
0
votes
0answers
119 views

How to find the correct page for wget to download from?

I want to download all *.pdf files on a website recursively. What I could achieve so far is: Store the cookies needed for the login page with this question Download a specific file by copy and ...
3
votes
2answers
10k views

wget or curl gives 403:Forbidden while downloading file from OneDrive for business

I'm trying to download software for a client which resides in my bussiness OneDrive account. Through the webinterface of OneDrive I do: Right click the file and select Share List item Change the ...
0
votes
1answer
153 views

How to download big sites with several interrupted wget:s?

I'm trying to download a site with wget, but the site is so big that I can't do it all at once. The problem is that the server is always reporting a new file and when I resume the download wget ...
1
vote
1answer
225 views

Wget batch of files fails, curl works, what am I doing wrong?

I am trying to download the entire directory from this website: https://data.geobasis-bb.de/geobasis/daten/dgm/xyz/ What I tried is: wget --show-progress -A 'dgm_*.zip' https://data.geobasis-bb.de/...
1
vote
0answers
31 views

standalone repo for upgrading

I am new to ubuntu I have an ubuntu 14.04 system on an isolated network (no access to internet) that I need to upgrade. I would like to pull a copy of a repo to use on this isolated network. I ...
0
votes
2answers
2k views

How to download website offline with authenticated username and password?

I have an account of this tutorial website testdriven.io, and I would like to download the tutorial offline for my team member to lean without having to login the credential. So, I tried several ways ...
1
vote
0answers
35 views

Wget website “drilling” for radio show elements

I run a Low Power FM community radio station and in addition to the live shows, we carry syndicated programs from producers around the world. Every week I spend way too much time downloading show ...
-1
votes
2answers
491 views

wget from file and save as acording to file name

I have multiple files, each file contains a URL. How can I use wget to read each file and download the URL inside it, save it as the container file name? EX : file name.frm contains : http://...
0
votes
3answers
531 views

difference between installation options for NodeJS on Ubuntu 18.04 LTS

I'm a brand new to Linux so this may be a rookie question... On a new installation of Ubuntu 18.04 LTS I want to install NodeJS. I ran node --version to verify that it is not installed: Command '...
0
votes
1answer
1k views

Error when using wget to download a list of URLs in a .txt file

My question is about downloading a list of URLs using wget. The URLs are listed in a text file named url-list.txt, which I have saved on my desktop. Whereas I'm using the bionic distro, on a 64-bit ...
1
vote
0answers
99 views

How to download specific files from ftp?

I wonder about how to download files, not all into index of directory. For example, my question is how to download specific files, which its name start "mat1", from 2015 to 2018 or index of 2018, ...
5
votes
2answers
4k views

How to get link of file to download with wget

I am using Ubuntu 19.10. For automation purposes, I need to download this file with a script. But I am not able to get the link. How can I achieve this?
0
votes
3answers
50 views

How to download certain folders from url

when I use this command: wget -r -np -nH --cut-dirs=6 -R "index.html*" -e robots=off "https://physionet.org/physiobank/database/challenge/2018/training/" It will download all the folders (994 ...
1
vote
1answer
517 views

Why does wget fail with “wget: symbol lookup error: wget: undefined symbol: psl_str_to_utf8lower”?

On a brand new installation of Ubuntu Linux 18.04, wget <URL> fails with, wget: symbol lookup error: wget: undefined symbol: psl_str_to_utf8lower I have tested that the resource exists at the ...
2
votes
2answers
3k views

install node latest version in linux

i am new in linux and want install node with bellow command: sudo apt-get install curl curl -sL https://deb.nodesource.com/setup_10.x | sudo -E bash - sudo apt-get install nodejs and angular 8 ...
0
votes
0answers
151 views

SSL not working for certain sites on ubuntu 19.04 server

So, on my new Ubuntu server I got recently, I cannot, for the life of me, get ssl to work with certain sites. I have tried adding their Root, Intermediate, and Client certificates to /usr/local/share/...
0
votes
1answer
3k views

wget not downloading entire file

I got historic house prices in UK from: https://www.gov.uk/government/statistical-data-sets/price-paid-data-downloads I ran the link for all historic house prices: wget http://prod.publicdata....
0
votes
2answers
2k views

Download a list of files with wget using wildcards

I have a list of files like: test.com/image01.png test.com/image02.png test.com/image03.png ... test.com/image50.png and want to download them all. One way is to write all names in a file and then: ...
0
votes
0answers
865 views

How to exclude folders from downloading using wget?

How can i exclude folders from being downloaded using wget ? For example if i wanted to download all of the files and folders of a subfolder: https://index.org has the following folders Folder1 -...
0
votes
0answers
115 views

Download Speed Rate Drops to 0 kb/s after 2 seconds!

this is ridiculous but my download speed drops to 0 kb/s after downloading about 200KB of a file... I've tested my network with other devices and it's fine but I still can't download with my laptop. ...
1
vote
1answer
5k views

Certificate problems

Many shell applications are throwing SSL certificate errors. I'm not aware of anything that could have caused this. apt, Google Chrome, Discord all work fine. Already tried: Problem with certificates ...
1
vote
1answer
1k views

wget unable to locally verify the issuer's authority but curl works

After updating from Ubuntu 16 to 18, wget stopped working (among other stuff), while curl works properly. $ curl -v https://google.com ... * Server certificate: * subject: C=US; ST=California; L=...
0
votes
0answers
378 views

How to use the command “wget” to download all files which satisfy to a URL that contains 2 wildcards “*”?

For example: This is all URLs of files in website.com : $ wget website.com/image/2007/dogs.jpg $ wget website.com/video/2007/cat.mp4 $ wget website.com/music/2007/sadsong.mp3 How can I make this ...
0
votes
1answer
2k views

Unable to download pdf file using wget

The website contains a button which I have to click to get the pdf to open. What I want to do is to use "wget" and the link of that website to download the pdf without me clicking on the button, and ...
1
vote
2answers
221 views

How to replace cp command with wget?

I am very newbie to linux and its commands. What I want is use cp command instead of wget to request from browser. Because I'm using docker and the mongo site filtered our country's IP. I have ...
1
vote
1answer
223 views

Downloading a repository from Github

I want to download and install fuse, I am following this tutorial Download and compile latest version of fuse source code. For this article, we are using fuse version 3.5. Following the set of ...
1
vote
1answer
142 views

wget mirror into my git direcotry

I want to wget --mirror into a specified directory. I can use -P <PATH> but it still makes a subdirectory with the website name. My Git directory name is buddhadust The website is http://...
2
votes
0answers
301 views

Using wget -i with flags

I want to start off by saying I am completely new to Ubuntu and still learning the commands. With that said I couldn't find what I was looking for exactly and if I missed it, I'm sorry. What I want ...
1
vote
1answer
65 views

Is there a way to transmit the computers location via WGET?

I have a little script which pings my server by fetching a web address via WGET. The idea is, should my computer ever go missing, I have a chance of tracking it down. Is there any way to add ...
2
votes
2answers
5k views

wget only download the index.html in each and every folder

for example: wget -m https://www.kali.org No warnings, no errors; What can be wrong? just to get more complicated I used the recommended command (see below) and the output is not satisfactory (yet):...
0
votes
0answers
275 views

wget command is not working on one particular internal web-site

I'm working on a server with Ubuntu 18.04 OS. I've double checked every network configuration. The "wget" works fine with practically every website I'm trying to download from. Although there's one ...
4
votes
1answer
2k views

How to allow wget to recursively download a whole directory instead of the “index.html” file

I want to use wget to download a whole image directory(something like mystie.com/images/) from one server to another. But when I go wget --no-parent --recursive http://mysite.com/images/ I am always ...
2
votes
1answer
648 views

How can you wget a file and execute it directly while giving arguments?

I want to download an executable and execute it in one step, while providing arguments to the executable. I managed to figure out to download+execute by using a pipe: wget -O - http://xrl.us/cpanm | ...
1
vote
1answer
58 views

Why when I use wget for a website does it download additional parts of the website?

I'm using wget -mirror https://www.website.com/sub/folders/here/ and want to download all of the content in the subfolders of the current location i.e. "/here/" . But instead, this command starts ...
2
votes
1answer
2k views

Using wget as a cron job to fetch contents of a PDF daily

I am wanting to fetch the contents of a PDF which is updated daily. I would like to set this as a cron job and have it fetch AND date the PDF file name (daily) so I always have a copy of each days PDF ...
0
votes
1answer
131 views

New virtual hyperv ubuntu 18.04 server installed but wget command not working?

I'm trying to use the wget command to download squid server from this link http://www.squid-cache.org/Versions/...-3.5.27.tar.gz. However I'm getting this "HTTP request sent, awaiting response... 404 ...
0
votes
2answers
2k views

Check download progress of 'wget' after starting it in background mode

I had to download multiple files using wget over a SSH Server, so I pasted the links in a file named 'link'. I used this command to download the files in background even after disconnecting from the ...
0
votes
2answers
92 views

Download file from list and assigning different names

I have a long list of files to download with the following syntax: https://url.url/YYYY/MM/DD/file.pdf Of course YYYY is the year, MM the month, DD the day. Is there a way to download the files on ...
1
vote
1answer
2k views

undefined symbol: EVP_idea_cbc when using wget

When try to run this sudo wget http://www.openssl.org/source/openssl-1.1.1.tar.gz I get the error below: wget: /usr/local/ssl/lib/libssl.so.1.0.0: no version information available (required by ...
0
votes
1answer
59 views

Wget all files from httpdocs or example.com/*

In my job I often have to move websites from one server to another. Till now I zipped all the files from origin's server httpdocs to a backup.zip and downloaded it on new server with wget old_domain....
1
vote
1answer
841 views

wget 1.20 package for bionic beaver

i am quite new to linux i am looking for the wget 1.20 package for bionic beaver according to wiki wget 1.20 was released on November 2018 , however i cannot seem to find the .deb file for bionic , ...
0
votes
1answer
903 views

wget cannot access a site on local network, returning this error: A TLS fatal alert has been received

I want to periodically download the index page of a monitoring web service, running on our local network (172...*:) that is using a self signed certification for SSL. I'm using these switches: $ ...
1
vote
0answers
107 views

In a new ubuntu 18, Ping works very well, but wget and browser error?

My system is Ubuntu 18.04 which was installed just now. I formatted the "/" part, but keep the "/home" part. The computer had been Ubuntu 14.04 before the reinstallation. The network wasn't right ...
1
vote
1answer
1k views

How to move N lines from one file to another

I want to download multiple files, so I decided to create 4 text files that are handled with a script. toDownload.txt | this file will hold a list of links to download. inQueue.txt | the files ...
0
votes
1answer
314 views

Published wget command line to fetch a PGP key for a repository doesn't work in 18.04

Trying to install SublimeText 3 on a new laptop. Various sources (including the SublimeText site, and "itsfoss") suggest this as a way to get the PGP key for the PPA: wget -qO - https://download....

1
2
3 4 5
9