Too keep your head cooler, it originates from the high humidity slavic banya culture.

As high humidity saunas, warm your skin up faster than dry saunas. You’ll not last as long, primarily due to your head overheating. So wearing a thick hat, will insulate your head from the temperature and humidity of the room