My best friend of 25+ years has always worn his socks inside out. He has always preferred the smooth finished side to the unfinished/textured “inside” of normal socks.

It has never been a problem nor will it. It’s just preference. Go for it, it’s not going to change a single thing other than how your socks feel.