I still think indentured servants and convicts from Portugal would do the job just fine (once again, The Cape and Portugal have the same climate), but knowing the Portuguese, they'd probably import slaves to do it anyway (Portugal was the biggest participant in the Atlantic Slave Trade).