I actually suspect slavery would have ended in the late 19th century. Keep in mind though, the end of slavery doesnt mean the granting of corresponding rights.
A large chunk (not all, or even a majority) of the south's stance on slavery was that the stance on slavery became the cultural touch...