Almost certainly fly as in birds came first. Trousers with a fly are a pretty recent fashion development, like within the last 200 years or so, whereas people have been watching birds since before the invention of language.