By voluntary associations (like a fediverse instance) absolutely not.

By government? Absolutely. What happens when disparaging the One True God Baby Jesus or His Followers is declared hate speech?

Whatever powers you give the government, you also give to the worst form of that government which you can imagine. The civil liberties that protect rapists and drug dealers are the same ones that are helping keep more people from being kidnapped by ICE in America.