For some people it’s not that easy to recognize. Maybe OP has difficulty with social cues. I have no idea, but it could explain why they don’t understand why it keeps happening.