Questions tagged [wget]
GNU Wget (or just wget) is a command line-based program for downloading content from the Internet using HTTP, HTTPS and FTP.
474
questions
-1
votes
1
answer
25
views
wget connection stuck - log file location? [closed]
A client of mine could not download anything via WGET from any website. He didn't get any error messages in the terminal. The connection simply remained in the "connecting" status. It did ...
- 143
0
votes
0
answers
10
views
wget link install prevents me from updating my packages [closed]
i accidentally installed wget -nc https://dl.winehq.org/wine-builds/ubuntu/dists/jammy/winehq-jammy.sources and now i cant update
0
votes
0
answers
16
views
Error when I am tried to install something [duplicate]
E: Type 'wget' is not known on line 53 in source list /etc/apt/sources.list
E: The list of sources could not be read
any app i try to install this error is coming up.
I am new using Ubuntu I will ...
- 1
0
votes
0
answers
15
views
`wget`: Cookies doesn't authenticate
I got some cookies from my browser where I'm well authenticated into a website. I've tried to give them to wget and make it download some internal pages, but all it downloads is authentication page
- 1
0
votes
1
answer
36
views
IPv6 DNS Problem with archive.ubuntu.com
Since a couple of weeks my mirror sync doesn't work as expected. I think that I identified the problem now. On my server the address archive.ubuntu.com resolves to a couple of IPv6 addresses and at ...
- 1
0
votes
2
answers
56
views
How to roll back or uninstall a script ran from wget piped to bash?
I piped the following script to bash using wget with the intention of installing a theme for bash.
wget -O - https://teejeetech.com/scripts/jammy/tweak_terminal | bash
Now I cannot find a way to roll ...
0
votes
0
answers
36
views
How to execute a command on a single file in a directory whilst looping though the directories recursively
I have the following structure
/ Cardio
/../ High
/../ High / download.txt
/../ Low
/../ Low / download.txt
/../ Medium
/../ Medium / download.txt
/ Warm
/ Warm / download.txt
/ Cool
/ Cool / download....
- 131
0
votes
0
answers
69
views
wget a file stored on local host from within wsl2 ubuntu hosted on the same machine
Why I do this:
I'm building a docker image from dockerfile which specifies several large files to be wget-ed from various locations, problem is, bad network.
Now I've managed to get all the required ...
- 1
0
votes
0
answers
122
views
how to fix download works on browser but on wget doesn't work?
so I wanted to download a video when I get the link and paste it into the browser it pops up a download notice and start downloading and when I try the same link on wget it dosn't work.
Keep in mind i'...
0
votes
1
answer
38
views
When downloading a file, why are modern browsers "unfair" when compared to wget? [closed]
Why do modern web-browsers behave unfair compared to a regular download using “wget”?
I'm aware the question is fairly vague (I took it from a recent exam in my networking course), and I could not ...
- 109
0
votes
1
answer
26
views
Own PEM file in initramfs
I am currently tinkering with the subiquity installer.
I would like to load the iso from a local https address
However the intitramfs keeps saying:
wget: error getting response: connection reset by ...
- 176
1
vote
0
answers
133
views
Installation of intermediate certificate not working for command line tools
TL;DR: No description on how to install a intermediate certificate works under Ubuntu 18.04. Any suggestions?
Before marking this as a duplicate of How do I install a root certificate?
or any other ...
- 11
0
votes
1
answer
32
views
wget download file to inurl directory
Is there any way to download file to inurl directory.
For example:
Here the url is https://url.com/api/discovery/manifest
I want the download structure be like
root_folder
- api
-- discovery
---- ...
0
votes
1
answer
183
views
How do I use wget to download from this website?
I am trying to download the dataset from this website https://motion-database.humanoids.kit.edu/list/motions/ but the website only allows me to download the folders one at a time by clicking on the ...
- 1,082
0
votes
0
answers
549
views
Cannot verify Lets encrypt certificate Ubuntu 20.04 LTS
I'm running Ubuntu 20.04.3 LTS \n \l which is updated as of today. However, any time I try and wget something, this error pops up:
# wget --verbose wops.cc
URL transformed to HTTPS due to an HSTS ...
- 21
0
votes
0
answers
76
views
What is wrong with my wget?
When i run this .sh script using bash, some files (I believe its the fifth, sixth, and seventh wgets) don't download, and give an error 503 despite being downloadable on browser with the direct ...
- 1
-1
votes
1
answer
195
views
wget to download files from list of urls and naming it from other list of names
I Have two text files - one of them contains urls of images that I want to download and other text file has the list of names corresponding to the urls of first files.
Example content of text file 1:
...
0
votes
2
answers
129
views
Can a virus be installed just by downloading a file?
Let´s assume that I programmatically download a malicious file, e.g. using wget, and try to import in e.g. R or Python as a text file. If it fails, I delete it using rm. There is any chance that my ...
- 145
1
vote
1
answer
183
views
How to always get the latest version of Bleachbit with wget in bash?
To get latest version of BleachBit (for Ubuntu 20.04) we can use the following commands:
wget -c https://download.bleachbit.org/bleachbit_4.4.0-0_all_ubuntu2004.deb -O bleachbit.deb
dpkg -i bleachbit....
- 1,914
0
votes
1
answer
77
views
How to create a list using the wget utility?
I need to use the wget utility correctly. I want to download content from certain links into one file and so that the result is saved in a list, and not in one row (that is, in one line)
For example, ...
- 3
0
votes
0
answers
13
views
wget --password:SECRET ; -bash: SECRET: event not found [duplicate]
I would like to wget a file from a password protected site.
I follow How do I provide a username and password to wget?
If I do:
wget --user=remote_user --ask-password https://www.example.com/file.ext
...
- 567
-1
votes
1
answer
88
views
How can I set wget to download only newer file in a specific url?
How do I get wget to download only newest file version in a url?
Sample url:
https://packages.microsoft.com/repos/edge/pool/main/m/microsoft-edge-stable/
As you can see, there are multiple versions of ...
1
vote
0
answers
173
views
MongoDb CLI install not working on Ubuntu 20.04 focal, behind a proxy [duplicate]
I am trying to install MongoDb CLI (https://docs.mongodb.com/mongocli/master/install/). I begin by running wget --no-check-certificate -qO - https://www.mongodb.org/static/pgp/server-5.0.asc | sudo ...
- 111
6
votes
1
answer
1k
views
Purpose of .wget-hsts file in Ubuntu
There is a file in my home folder named wget-hsts .Does this file send my data to anywhere ? The file content is as follows :
# HSTS 1.0 Known Hosts database for GNU Wget.
# Edit at your own risk.
# &...
- 155
0
votes
0
answers
44
views
Attempting to verify hash sums for installed binaries openssl, wget, and perl
I am trying to verify if the installed binaries on my system for openssl, perl, and wget are valid. Per a Lynis audit these binaries are just "Found" instead of "Found known binary.&...
- 13
0
votes
1
answer
161
views
wget can't find url inside local file
I have an html file.
page.html:
<html>
<body>
<img src="picture.png">
</body>
</html>
But when i run wget as follows, it doesn't fetch the picture. ...
- 1,447
0
votes
1
answer
146
views
Download FTP directory and files in remote Ubuntu server via SSH
I want to download the files listed in a FTP directory, ftp://ftp.ivc.polytech.univ-nantes.fr/NAMA3DS1_COSPAD1/Avi_videos/HRC_00_Reference/. On my WINDOWS laptop when I put this link in the address ...
- 101
0
votes
0
answers
32
views
Why vscode is not shown when ran from inside the container?
Based on this article and this one I realized that I can run GUI apps from within a docker container. And I successfully ran Firefox from a container and saw it and interacted with it in my local ...
- 317
0
votes
0
answers
14
views
error while loading shared libraries: libxshmfence.so.1: [duplicate]
I'm trying to install VS Code inside a docker container and run it from there.
This is my Dockerfile:
FROM ubuntu:latest
RUN apt-get update && apt-get install -y firefox
RUN apt install -y ...
- 317
0
votes
0
answers
66
views
How to download directory/folder from repository with credentials
I have a repository that has directory/folders named /scripts and I want to download this whole folder with its content and subdirectories.
I tried wget command:
wget --user xyz --password xyz-pswd --...
- 123
4
votes
2
answers
1k
views
CA Certificates Not Recognized
I've been trying to get CA Certs installed because I'm getting errors when trying to use rosdep init which makes calls to "raw.githubusercontent.com". If I do the same call with wget I'll ...
- 151
0
votes
0
answers
23
views
How to follow links on a SPECIFIC webpage and analyse them recursively to download files using wget?
I am trying to download audio files from a webpage using wget. I cannot get the command right.
Let us say the files are on the page http://songs.com/artists/name/album/2020
On this page there are ...
- 45
0
votes
0
answers
298
views
Getting confused of --no-parent for wget
I'm trying to grab some pages from some government website, so I use
wget --convert-links --recursive --no-parent https://www.canada.ca/en/immigration-refugees-citizenship/services/immigrate-canada/
...
- 143
0
votes
0
answers
57
views
wget issue to download all files from mailchimp
I just want to download all my files from Mailchimp but it did not work.
error:
$ sudo wget -r -P https://gallery.mailchimp.com/randomdetailsgeneratedbymailchimp/images/ .
I tried this https://...
- 23
0
votes
0
answers
100
views
Unmet dependencies when trying to install PostgreSQL with apt [duplicate]
I am trying to install postgresql in ubuntu 20.04, but facing unment dependicies issue.
You might want to run 'apt --fix-broken install' to correct these.
The following packages have unmet ...
- 11
0
votes
1
answer
78
views
wget a link with google redirect
Got a page full of downloads but all using https://www.google.com/url?q=http://www.$$$/*.pdf&....
I can download using http://www.$$$/*.pdf direct but there are 50+ files. Anyway to avoid this? ...
- 1
0
votes
0
answers
36
views
Is there any trick to collecting data from a web page that using JavaScript and setting current time and date automatically?
I work under Ubuntu Linux in the terminal, using shell script wget, httrack and:
google-chrome --headless --dump-dom 'https://www.pref.kanagawa.jp/sys/taikikanshi/kanshi/realtime/index.html' > ~/...
- 1
0
votes
0
answers
41
views
How do you use wget to install files that change urls
I run a Minecraft server, but when I am trying to make it so every time the server starts, it would look for updates for plugins etc.
#!/bin/sh
wget -O EssentialsX.jar -P ~/Desktop/BlizzardMC/plugins ...
- 1
0
votes
1
answer
197
views
Why use tee with wget? Isn't it superfluous?
So I came across this code for downloading youtube-dl using wget which pipes into tee here: How can I update youtube-dl?
The code being:
wget -O - https://yt-dl.org/downloads/latest/youtube-dl | sudo ...
0
votes
1
answer
89
views
Why does wget try to access wrong target?
I am trying to mirror a site which I manage for backup purposes.
Here is my wget command:
wget \
--mirror \ # Download the whole site, updating local files as needed.
--page-requisites \ # Get all ...
- 186
0
votes
0
answers
113
views
how install wget ver>18 on ubuntu 16.04?
I need to install wget newer version >=18 on ubuntu 16.04.
sudo apt-get install wget
installs wget 17 version
1
vote
2
answers
775
views
wget not working failed: No route to host
I'm using Ubuntu 20.04. Every time I use wget I get
failed: No route to host
for every website. What could be the issue here?
root@zubuntubase:~# ping -i 3 https://dl.winehq.org/wine-builds/winehq....
- 31
1
vote
1
answer
169
views
WGET image files from source server using CRON to run a SCRIPT using a PHP-mySQL-based generated list
I am trying to setup a process which would do the following :
I have a folder where image files are stored (various resolutions : l/m/s/xs): WORKING !
each day, a mySQL table is updated/completed ...
- 11
1
vote
0
answers
75
views
Auto-downloading files from password-protected website; wget making me crazy(er)
I run a community radio station that airs radio shows from all over the world. The audio files for these come in via RSS, Dropbox, emailed links, and by visits to private servers. The RSS-fed shows ...
- 29
0
votes
0
answers
141
views
Download all linked mp3 files from a website using the terminal
I'm trying to download all the mp3 files from this URL using wget, but haven't had much luck. I've tried this wget command wget -c -A '*.mp3' -r -l 1 -nd [URL] and I've tried a few other things with ...
- 101
0
votes
1
answer
5k
views
how to use wget to download shared zip file from google drive?
How do I download the zip files here https://drive.google.com/drive/folders/1PYSJLae6m9Bb55NADlFUdtEKH9UHML-l using wget?
- 1,082
18
votes
1
answer
9k
views
How can I download an HTML webpage including JavaScript-generated content from the terminal?
On Google Chrome, when we go to the development mode, right-click an HTML element → Copy → Copy element, we can copy the HTML content of a webpage. Below is an example of the procedure I've described:
...
- 383
0
votes
3
answers
971
views
Impossible to wget a link with php redirection
I tried all the tricks I could find to download this link from terminal using wget and curl :
http://libgen.gs/ads.php?md5=5C757EA95B47CEAB5065B26EEB55896A
None succeeded to get me the epub book that ...
- 13
0
votes
1
answer
161
views
Does wget remember which URL has already downloaded on each job?
Lets say I run wget to download a website or forum thread that contains several pages and start the download in the last page but as you know they always link to the first and last pages so wget will ...
- 103
0
votes
0
answers
769
views
How to download AES 128 encrypted HLS Stream?
I want to download AES 128 encrypted HLS stream into a mp4 on Ubuntu 20.04.
I have the m3u8 file but it has URI for key as k/timestamp.
I have the timestamp file but it shows bizarre text when opened ...
- 121