Is it possible to install Ubuntu 13.10 on pendrive? I don't want a Live Ubuntu from unetbootin, because everytime I run Live OS all settings gone.
I think this is what you are looking for.
Basically this link says to use Ubuntu's Startup Disk Creator with an empty 4GB USB stick. You can configure how much to give to your persistant home directory from there.
Hope that helps.