I am very new to Ubuntu and I've installed Ubuntu 14.04 in English and than added Hebrew to it (as a second language).
When I switch from English to Hebrew via Left-Alt+Shift (The combination I defined) I can use the language itself just fine but I can't switch between it and universal-characters\ Key-alternatives via Caps lock key (as I can with all versions of Windows).
In Hebrew keyboards we use Caps lock for alternative usage of some keys. For example:
ף=; ת=, ץ=.
Note: Both characters from each side of the equality mark are initiated by the same key in typical English-Hebrew keyboards - Depends on Caps lock.