It’s actually exactly the same, but not rude to people who take things offensively. It’s cool that you’d appreciate that option, but not everyone would like it expressed that way and websites have to appeal to everyone.

FWIW, at least as far as the US govt is concerned and these statistics are required for diversity data, “Prefer not to say” is counted as Male.