In an ideal society? No.

However, in our current patriarchal nightmare, people other than cis-men need various special protections to soften the impacts of sexual violence, sexism, discrimination, and inequality, hence the need to have legally defined genders.