I too had a decent upbringing, but, after a bit of introspection about why I'm so wary of my own name, it came down to this:

I have two names. One is my given name and the other is "son".

My parents have always tended to use my given name in negative and neutral contexts and "son" in more positive ones. It's not intentional on their part, and I expect my father got the same, but I think it's at the root of it all.

Good upbringing or not, how many of us are still terrified of being addressed by our full name in an irate tone? I'm convinced it's related.

The only wrinkle that bothers me is when a sonless aunt once called me "son" and it made me very uncomfortable. But, I figure there are other reasons for that.