Press and hold the mute button to mute your mic and to turn off sound output from the speakers on your controller and TV. Press the mute button again to return to the original state.

PS5 Quick start guide, page 11.