So I added a file called gradle.sh to /etc/profile.d/ that had the following lines:
export GRADLE_HOME=/home/gradle/
export PATH=$PATH:$GRADLE_HOME/bin
I restarted my machine, so that it would pick up the changes. Now when I go to log in on any user, I get a flash of a black screen with some text (that I don't have time to read), and it goes immediately back to the login screen.
I was using this tutorial to get through setting up my gradle install, https://help.ubuntu.com/community/EnvironmentVariables