Yes, if Charles would have got a home country 'Burgundy' (in the broader sense, so not just the Low Countries) would have been. However he saw some potential issues from ruling those lands from Spain. There were two alternatives considered. Either the Burgundian Lands or Milan would together with 4 appanage duchies pass to a French prince, who was to marry a Habsburg archduchess (either Charles' daughter Mary or Ferdinand's daughter Anna); still given the desired French contribution that probably never had a much chance to succeed.
A more realistic alternative was giving the Burgundian Lands to Mary, who then was married to Maximilian II, the eldest son and main heir of Ferdinand. That seems a likely compromise for such a transfer to have happened.
Even earlier Ferdinand had desired Milan for his own branch, not only did he have a healthy large family; but Milan could in hostile hand potentially threat the Austrian Lands, so naturally it was also interesting for the Austrian branch.
Then again it could also serve Spanish interests in Italy. Anyway disputes over Milan and Charles granting it to his son, was the beginning of worsening relations between Ferdinand an Charles.
This only got worse, when a bit unrealistically Charles had the desire for his son Philip to succeed him in the Empire, after Ferdinand, whereas Ferdinand preferred his own son Maximilian II. I intended the use unrealistic, because Ferdinand and his family knew the Empire and the Empire, like Spain and 'Burgundy', didn't like the situation with a ruler, who was more absent than present. Not to mention, the fact that the Prince-Electors, also preferred the 'native' Austrian branch over the foreigner Philip II. A bit ironic, since Ferdinand I, also started out as Spanish archduke, but, also due to his Lands, was able to firmly establish himself in the Empire. Philip II OTOH had too much obligations in 'Spain', which just made it not credible for him too have enough time for the Empire.