It’s almost always the caps (capacitors). They have a very distinctive whine while energizing, and it can also cause some reverb in the speakers. It settles into a subtle whistle when fully energized. 40 some odd years and I can still hear them every time I turn on a computer tower, a TV, an amp, etc. I’ve learned to tune them out most of the time.