I know this isn’t an awesome answer, but safety is more important than standing your feminist ground sometimes: either go to another yoga class or bring a friend. It sux to rearrange your life because of some weirdo, but less than being attacked. Also, consider keeping mace or a whistle on you in case there is a confrontation.