The southern Chinese population quickly realized they could do much better economically by serving the much larger African population rather than work fields.
Basically what they did everywhere else with a black majority. Europeans were much more willing to have them service blacks than blacks serve their own.