This seems to be an issue that only manifested in the last few versions maybe 14.04+.
Win/Super works as desired at the computer itself. Through TeamViewer however Win/Super is instead mapped to Alt.
I do have
Send Key Combinations checked in TeamViewer and any other combinations seems to work as intended Ctrl + Alt for instance.