One reason would be international pressure. And CSA is hellish dependent on international trade. And rising economy and industrial level would make slavery at least in large scale very impractical. Yes, there would be servant slaves quiet long but eventually that situation would be changing.