Headphones vs speakers is way less significant than listening volume. The big thing to be careful of is listening with just one earbud in. When we do this we almost always end up turning the volume in that one too high, because you need on average 6db more volume to compensate for the audio input of the other ear.