I'd say no way. Prior to turning to the African slave market, of course there was an alternative supply of labor to work hard on plantations, but importing British convicts and desperate indentured servants was risky in that they could vanish into the general colonial free labor pool if they escaped. An African appearance was better by far than branding someone, and you could only do that to a British subject if they were convicted of committing some serious crime. Whereas when the plantation work became work for permanent African slaves with no prospect of freedom, whites who would be mortal class enemies in Britain could be relied on, generally anyway, to assist in stopping runaway slaves and handing them over to the authorities who would return them to the owner, if only for the bribe of a reward. But with the development of racist ideology in its earliest form, poor whites would generally take pride in helping keep the slaves in their place, and regard their interests as shared with the plantation owners and other well to do. Thus, the teeming legions of British poorhouses and jails could be leveraged into foremen and overseers in America. Thus the total labor force that could be controlled was far larger than would have been the case had British colonies continued to rely on Britain for its lowest classes of laborers.
Of course generalizations that applied to the average British American colony were not strictly the case in the North American continental colonies, not all of them. Those with the largest slave populations like South Carolina most resembled the more profitable sugar islands the evolving imperial system was preoccupied with; the continental colonies were auxiliary to these, and most had far fewer slaves per white colonist. None were free of slavery completely though the northern tier had so few that abolition was easily accomplished there. In the middle, the slaves made up only a small fraction of the total population but were common enough that the system felt threatened by any talk of abolition.
Your post seems to assume the USA popped up out of the ground in the middle of the 1780s, without having a century or so prior history. Most African Americans today descend (on their African sides anyway) from slaves imported before the Revolution. The USA came into being with a huge percentage of its population being African slaves, by then mostly born in America. The pattern of forming stratified racial relations, where even poor whites felt they had to stand in solidarity with richer ones against the perceived dangers of the black population getting out of control, was well-worn then, with even northern colonists witnessing a few instances of slavery every day. By this time entire categories of work in the slave-heavy southern colonies/states were stigmatized as properly slave work, and the local white poor workers would not do it even if well paid--nor would the plantations or small businesses using slave labor be nearly as profitable if they had to offer wages high enough to tempt free whites. Quite a few would probably go straight into the red. Ongoing slavery was immensely profitable for the Union as a whole; even businessmen who would not touch slavery or slave-using enterprises directly benefited from the balance of payments and ease of raising capital. There were people visionary enough to denounce slavery even so but it was hardly a comfortable message.
Now if you want to prevent slavery forming an invidious association with Africans--well pretty much, both slavery and Africans would have to be prevented from being accepted in the colonies at all. Given that the purpose of the colonies was to be profitable for investors in the motherland, I fear this is largely tantamount to saying the colonies should not have been established at all. A few of them could have been justified solely on the grounds of the push of some categories of British subjects to get out of British conditions, but where would a typical malcontent of that type get the funds for the massive investment necessary to establish and secure the colonies? The Puritans were a special case and limited. Overwhelmingly the colonies existed as a scheme to get rich investors in Britain richer.
Perhaps certain categories of Europeans would suffer such bad treatment as transportees they would ally with the desperate Africans--one can imagine the Irish doing so for instance. But in fact steps were taken to prevent and defuse that very alliance, and generally speaking the exploitation of Africans was seen as a ramp that elevated all Europeans to a higher level of social respect and opportunity.