I remember reading he also just laughed it off and said people are just paranoid and see what they want to see.

A pretty good tell-tale sign of a fascist is that they will never apologize or admit doing wrong. You have to appear strong at all times.