“bisexual” doesn’t mean “men and women”. It means “homo and hetero”, as in “those of my gender and not of my gender”.

Which is exactly what “pansexual” also means.