I first say, thanks for your time, this may be a known issue but I couldn't find it the answer.
How to replicate:
- copy your public SSH RSA key to ~/.ssh/authorized_keys
- reboot ubuntu 12.04 desktop edition
- try to ssh (it will prompt for password)
How to fix:
- Go to the server and log into unity.
- Now ssh public key auth works fine.
- SSH the server
- SSH it again, now public key auth will work fine.
This behavior is unusual (I'm a linux admin) hopefully someone knows a workaround?