I installed a program using
sudo make install. Is there a command I can use to remove these files now?
It totally depends on the author of the makefile. Sometimes you can run sudo make uninstall from the same directory that you ran that command from, but it's rather rare honestly.
This is why it is usually best to install only from .deb packages, since they almost always can be cleanly removed from your system.