Yes, the timing does not change whether the source is directly in front of, behind, above or below you, but people still tell these apart somehow. I think it’s the frequency response of sound from different directions reflecting off earlobes.