For the most part, originally, slavery was permitted in all of the colonies. However, it is considered more a competitor to wage labor, which it will eventually lose out to. New England doesn't have the agricultural need and slaves are needed for commerce.