Like potential Protestant refugees who are fleeing from their war torn lands. I mean, you could even have Estonians migrating to the Americas as well as Swedes and Finns.
The colonists don't have to be Swedish; I'm sure there will be Germans who want land in the Americas and would jump at the chance to immigrate to the Americas.
But was there anything else? That's my point - being able to establish an empire by armed force is one thing, seeding settler colonies needs surplus population.
Germany didn't have any colonies for them to pour into?