Portugal was the first to get all into the black slavery business, and Negro does happen to mean "dark" in Portuguese...
... Which, when I think about it, is all the more reason that this would be possible; keep being called what the first European slavers named you, or get a new name?