As someone pointed out, this happens due to the source output being surround sound, which causes this effect when listening with stereo speakers.

Good news is if the TV or media player doesn’t have a Stereo option, usually there’s an option to force Mono audio which sometimes does the trick. If your speakers are shit enough you can barely tell the difference!