While it’s not an “excuse”, I think the “explanation” tends to be that speech from Nick in Zootopia: If people are going to regard you as shifty and untrustworthy, why bother being anything else.

Like I said, not a valid reason, but I do see how that toxic manosphere grows through fear.