I have heard it used as a racial slurs once I the film True Romance (1993). It has a scene where Dennis Hopper’s character is explaining to Christopher Walken’s character (a Sicilian) how he’s “part eggplant” due to the fact that the Moors conquered Sicily in the past.

I’d link to the scene on YouTube but I don’t want to as it’s very racist.