This used to happen only if I do it before Ubuntu was fully loaded or if it was just waking from a suspend, but now it started happening always. My laptop is Acer Aspire 5740. Can the OS suppress this beep?
To remove the PC speaker driver type
In Addition try System -> Preferences -> Sound and select the System Beep tab. Then de-select the system beep.