Historically, I’m quite certain that the “small” people (e.g. peasants, and such) had always had incredibly right-wing views, including tribalism (we’re better than anyone else, for no reason, we just are), “hard-work” ethics, who doesn’t work doesn’t deserve to eat, and such.

The landlords couldn’t care less about immigration. As long as the immigrants pay their taxes, the landlord is happy. Why would they bother?

It’s the peasants who see their land occupied (sothat their own land’s relative share decreases) who get furious at the foreigners who take their jobs and eat their food, while also possibly bringing infectious diseases and an inferior way of life.