You say you didn’t give them ammunition, but IMO you’ve done exactly that by giving them this weird “power” to make you feel like you should hide your true age or apologize for anything.

“Why aren’t you married?” “I haven’t met anybody worth making that kind of commitment to.”

“Why didn’t you have kids?” “Because I don’t want any (at this point).”

Live your life according to your own schedule and speak your actual truth.