Select all the tracks from the album, right click, choose properties. Don't change the artist or album tag. Set "album artist" if you like, or click on the "sorting" tab. Here, you can set an artist and album tag that will not be displayed, but will be used specifically for sorting. If you set "Album sort order" to "greatest hits 1" for example, and set it to "greatest hits 2" for the other album, they would still both show up as "Greatest Hits" in the library, but would be sorted as separate albums. Better solution would be to change the "artist sort order" field to the corresponding artist's name. This is also a good solution for albums with multiple artists.
You can also use this if you like your albums sorted chronologically, as Rhythmbox doesn't have the "album by year" feature that I've only ever seen in iTunes.
Sorting your library using the "Artist" heading rather than "Album" would solve this problem much more easily; your albums will still be sorted alphabetically, with their tracks in order, and albums by the same artist will be grouped together. That way Offspring and Queen wouldn't even be near each other, let alone all mixed up like that.
I know this question is pretty old, but no one seems to have posted this solution. Hope I helped someone.