I followed the steps in this thread: What happens if I disable and unistall Plymouth?
Now GRUB is broken. I'm running Ubuntu 12.04.4 without a GUI and when my server boots now, I get a screen showing what services are starting and then it says:
umount: /proc/fs/nfsd: device is busy.
When I press the arrow keys, it alternates from this screen and the purple Ubuntu splash screen.