amount of folders in home directory is not an issue.
I am running a Core i7 CPU with 8 GB RAM and mine take from 95 seconds (minimum) to 125 seconds (maximum) just to bring up the GDM Login screen and then about ~25-35 seconds to show desktop after login. There are 11 directories inside my home directory and several applications that I enlisted to run at startup but none of them is heavy enough to affect the startup. I think this is an issue with the release as there are so many users complaining about the same. Previous setup of 12.04 on same machine used to bring up the desktop under ~20-30 seconds.
I also tried asking for help is IRC channel #ubuntu but nothing helped with the delay which occur after login to bring up the desktop. Looks like this is something to do with services which runs after login but I am all clueless. Hope someone can help us resolving the problem.