rm ~/.local/share/rhythmbox/ ~/.cache/rhythmbox/ ~/.gconf/apps/rhythmbox/ -r
but that only ended up removing the database. I want to remove some folders in particular. How do I do that? Are there symlinks involved?
When you select your directory in the preferences, it automatically reverts to "multiple locations". This is because there is at lease one other location set automatically by the Ubuntu One Music Store:
Now, don't delete this directory :-)
You can check what directories are set as library locations by opening the gconf-editor (hit Alt+F2 and type
This is what it should look like after you've set your library location to ~/Music:
I recommend you just leave it there, and just use the gconf-editor to make sure there aren't any other locations set. But you can also delete the u1 music store entry (though I wouldn't be surprised if the ubuntu one plugin just added it again).
In case you do decide to delete either the directory, the gconf entry for it, or both, be safe in the knowledge that you can't break anything by doing that, none the less, you may as well just leave them be; in case you decide to use the Ubuntu One Music Store one day. They don't slow down Rhythmbox at all; you won't even know they're there.