Also, the climate of the North was unsuited to slave-based agriculture.
Could we possibly, with an early enough POD, have had serfdom in the North (de facto, by means of possibly-hereditary indentures) and free landowning farmers in the South? On the other hand, this would probably have hindered industrialisation- see Russia for an OTL example.