The way I see it isn’t that stereotypes are inherently awful, it’s that they have various levels of impact. Racism against African Americans is considered more heavily because they have such a long history of oppression that not many other groups have had. Most other groups didn’t meet fierce resistance to obtaining basic rights for as long as they did