To keep things quick, does Ubuntu index thumbnails so that, next time I enter that folder, it doesn't have to reload the thumbnails? (This would be especially important in large picture folders.)
Yes it does. More specifically, it is the file manager that does this. Normally there is a limit to the size of files that are indexed however, and also it usually does not index remote files IIRC.