About 20% of the time, when I resume Rhythmbox from a paused state it will seek forward an unspecified amount of time, anywhere from a few seconds to several tracks. It seeks at about 1min/sec.
It seems to me as if it is trying to find an uncorrupted part to play, but the tracks work fine before pausing.
Gist of debug output after play key is pressed, the problem occurs, Rhythmbox settles down, music is paused again, and Rhythmbox is closed: https://gist.github.com/Sprakle/5518891
This is all done on a Fresh install of Ubuntu, it never happened on 12.04