Read my other comments. I link this because this is the only real source, and for reference. A German! Wikipedia article.

No, nobody was an idiot for not seeing this, most Germans would not know that this was a Nazi symbol. And wearing those symbols is illegal here.