I'm not sure why people say this is such a rare issue, it happens to me on every distro regardless of keyboard or computer. Using shift is a good workaround since it will save you time and make your life easier in the long run. I type very fast, however, so I constantly run into this caps lock issue and using shift hasn't been worth my time until now because it slows me down.
You can change the keyboard map on most distros to fix the issue (ish) by doing the following:
xkbcomp -xkb $DISPLAY /home/yourusername/myxkbmap
nano /home/yourusername/myxkbmap
Once you're editing the file, locate the part that says key <CAPS>
and remove it. You'll find it about halfway down the file.
Replace that line with this:
key <CAPS> { repeat=no, type[group1]="ALPHABETIC", symbols[group1]=[ Caps_Lock, Caps_Lock ], actions[group1]=[ LockMods(modifiers=Lock), Private(type=3,data[0]=1,data[1]=3,data[2]=3) ] };
Then save and set the file to your keyboard map by entering
xkbcomp /home/yourusername/myxkbmap $DISPLAY
Limitations
This is not a perfect fix, and you'll notice that this kind of turns the caps lock key into a shift key itself. So before you would get something like this: "I'M jason" and now you'll get "I"m jason".
This is a minor inconvenience since the only time you would notice this is if a character came right after a capital letter (like "I'm", but those are uncommon).
Feel free to set this as a startup script to run each time you turn on the computer. Note: when you start from sleep the keyboard map resets so you'll have to manually run your script again.
Known instances of this not working
For some odd reason, this fix only works on Debian/Ubuntu based distros (as far as I've tested it). So forget it if you're using Fedora or OpenSUSE or something else non-Debian.
Also, this fix oddly doesn't work on newer kernels. I use Ubuntu 20.04 LTS a lot because it's the most recent LTS for me. As far as I've tested it works on every version except 21.04 or higher.
I'm on the hunt for a fix for 21.04 and other systems, but since the amount of people who use caps lock to capitalize is few, almost nobody knows what the issue is or how to fix it.
Besides that, this does work really well for me on almost every system I've ever needed. It's always the first thing I set up when I switch to a new distro. It's sad that it doesn't work on newer Ubuntu versions though. If this truly bugs you, give it a try and you might save yourself some sanity.