The Dutch probably really did not want to have Nieuw Amsterdam:
1667: They had won a war against the English, but lost Nieuw Amsterdam. However, it was allowed to stay English.
1674: They had again won a war against the English and recaptured Nieuw Amsterdam, but promptly traded it for parts of British Suriname.
Cape town was lost over a century later when revolutionary France forced the Netherlands in an alliance against Britain. Difficult to avoid without eliminating the French revolution.