I think this is the key point. The British might have been able to pull it off(clearly debatable), but why would they?
Why take territory for a colony(s) that's not particularly valuable in the first place, when all you'll do is instill a sense of vengeance in the country you took it...