Because it’s not commonly used that way. If we avoided anything that had at some time been used as a slur, we’d only have about 3 names to pick from. (Of course I exaggerate, but it’s better than saying “it would retard growth”, isn’t it?)