You shouldn’t feel bad for making a reasonable request considering the compromise of letting him do it most of the time without saying a word.

Is it ideal for him? No. Is it ideal for you? Also no.