You haven’t factored in the the north’s economy was based on manufacturing things using materials from the south. Industrialists got rich from it and that’s a major factor in why New York cops were returning slaves before the war.

The Industrial Revolution was powered by coal from the south.

Before the public works and refrigerated train cars that made California a farming state, a lot of food was grown down there.