I usually dry inside and I make sure to turn stuff inside out before hanging it on the rack but I do it because I believe it dries better when things like pockets can be stretched out.

UV is a great point, I never realized that.