I don't know how really this question is related with Ubuntu, but it is fun and I will write an answer.
I have a phone with Android 4.4.4 and often use these tools:
How to connect Android device over USB to SSH into a laptop running Ubuntu
1. Open HotSpot app, go to USB tab and enable USB network sharing. We don't need the connected device to use mobile data over USB, but this option will prepare virtual network that we will use.
2. Open Network Discovery app, go to Settings menu → Discovery → Discover Method → Ping/c.... Go back to home screen and tap on Discover. When this process finishes copy the IP of the target network device. There shall be only one device.
3. Open ConnectBot and setup your SSH key if it is needed (tap on the menu in upper right corner).
4. Setup a new connection - use the discovered IP, and tap on + ADD HOST to save.
5. Go back to the ConnectBot home screen, tap on the new connection and use it.
Additionally if your Ubuntu has GUI and properly configured VNC server, you can setup port forwarding for ConnectBot's connection and can use RealVNC Viewer to connect with your desktop. Pocket Bluetooth keyboard and mouse make things really nice.