Tolerance is a social contract. Only those who abide by the contract are covered by the contract. Intolerant people do not tolerate others, and therefore they cannot benefit from the social contract.