My dad gets legitimately angry when I do this

I think it has to do with “putting the waiters out of their job”. Like, when you do a part of the job for them consistently, the restaurant manager will eventually notice that and realize they can do with a little bit less staff. So they hire fewer waiters, which means potential waiters face a tougher job market.