I changed my SSH port in the
/etc/ssh/sshd_config file and then restarted the ssh service. I implemented fail2ban and updated the port to my SSH under that config. I also then implemented the UFW firewall and allowed incoming connections to my new SSH port.
However, when I try and login with my SSH key using
ssh -i /Users/myuser/.ssh/vpsssh firstname.lastname@example.org it's trying to connect to port 22 instead of the defined port I have.