Maybe high frequency pickup on the ground/input causing the internal amplifiers to oscillate. It be EMI from its own internal power supplies. If you have something like LED or fluorescent lighting it might pick up high frequency noise from that.

Could also be the ripple on the power supply increasing as the voltage drops from having no input.

Perhaps try using an app like spectroid to try and figure out what frequency the noise is