One of my best friends in college told me basically verbatim what I wrote in my comment. She said that she was glad she was a D cup and on the shorter side because it meant she could date guys who go to the gym and her pool of options was big because of her height.

So I think it might happen more often than you think. Probably not as big of a thing as height differential, but seems to be a thing from my personal experience.