As far as I'm aware, the Swedish Empire had, once upon a time, a colony on the Gold Coast centred around the Cabo Corso. Naturally, in our timeline, the colony was decimated and captured by Danish forces, and afterwards, conquered by the English from the Danish. Seeing as pretty much every major European colonial power wished to colonise the Gold Coast region due to how lucrative the Triangle Trade was, I don't think it would have been particularly impossible for the Swedish to have shown greater interest in maintaining their colony to the point that they'd have kept it for a few more centuries (as the British did), perhaps even reach an equivalent of the Scramble for Africa and go on and expand it to the entire region of what we know today as Ghana.
How that would happen, though, is up for you to decipher, if you dare accept this challenge.