By the mid 1800’s, chattel slavery was around in the USA for over 200 years. Even after slavery ended, an enforced caste system was put in place.

You would need the robots a lot earlier to prevent the slave trade.