Sorry mate, not how language works. Men is a noun, male is usually an adjective, they aren’t interchangeable. Depending on the context, it can be weird/wrong to call groups of people by an adjective (exp. illegals, poors, disableds). Hearing men call women “females” sounds weird af dude, you’re proving OP’s point.