How can I, as an Ubuntu beginner, get a daily snapshot of a webpage? The page requires a log in and then displays a bunch of numbers that I'm interested in.
Can I write a script to take care of this?
(I am on a waiting list for college dorm housing and want to keep a close eye on the progression. There's a long list of daily updated info that I would like to store somewhere I can easily flip through it.)
Edit: so I used Rinzwinds script and did some research on my own, here's what I have so far:
#!/bin/bash filename="kkik" url="https://www.kollegierneskontor.dk/default.aspx?func=kkikportal.housingrequests&lang=GB" date=` date +%d%m%Y` output="$filename-$date.html" wget --save-cookies cookies.txt --post-data 'Page_ctl05_Main_ctl04_form_loginUserName=*****&Page$ctl05$Main$ctl04$form$loginPassword=******' wget --load-cookies cookies.txt $url -O $output
it successfully downloads the 'you don't have permission' page (if I take out the cookies and post stuff it gives me a 'you need to log in' page, which is different). Am I missing anything obvious? It doesn't seem like an overly complex website.
I'm sure if I Get the script to run, I'll figure out how to make a CRON job out of it.