Oh yeah that was the worst. Game devs really shooting themselves in the foot with that design.
Once paused, should it just be a single button? Maybe a menu with an “are you sure? Y/n”, or maybe a hold down one or two buttons together for a couple seconds like on consoles?