Castro was under existential threat from the United States which still essentially considered Cuba its property. It's more a case of better dead than enslaved.
Last time I checked the US didn't practice slavery. The absolute worst case scenario is that Cuba winds up a US puppet state instead of a Soviet one. In that case it has a couple more military bases, winds up with slightly better tobacco.