This assumes you can copy-and-paste between the host and the virtual machine guest; it's easier than setting up sharing between the two, and more secure than emailing your private key to yourself, leaving key files lying around, etc.
- Host AND VM: Open a terminal, and
sudo apt-get install xclip (a small tool to copy and paste to the clipboard from the command-line)
- Host: Type
gpg --list-keys and select the 8-letter "pub" key you used for PPA signing, e.g. if the output is pub 2048D/ABCD0123 2012-05-02, you want ABCD0123.
- Host: Type
gpg -a --export ABCD0123 | xclip
- VM: Type
xclip -o | gpg --import, to add your public key.
- Host: Type
gpg -a --export-secret-key ABCD0123 | xclip
- VM: Type
xclip -o | gpg --allow-secret-key-import, to add your private key.
That's it!