You’re doing what they do to you back to them. This is not hard to understand. You don’t like it, so they don’t like it. You’re essentially “proving your point” by taking revenge. The only thing they hear is that you’re taking revenge.

If it was about boundaries, you could say something along the lines “I don’t like these kind of questions, I am perfectly comfortable being quiet, with this question you make it sound like something is wrong about it. I get this question all the time and I don’t want to answer it anymore.”