In a word - -logistics.
An invasion, as distinct from a raid, means transporting an army across the Channel. You have to land it in one place at one time. That mean a LOT of ships, hundreds, maybe thousands.Remember, it's not just the men - you have to transport horses, cannon, powder, shot, stores, water (especially water). Unless you can rely on support from local forces you can't send a small force and reinforce it .
You won't be able to land a fleet that size in any defended harbour (assuming this is a real invasion, and you don't have local support). So you must land on beaches, as the Vikings did (or D day ). That means flat bottomed boats. Those are nasty things in waters as turbulent as the Channel. You must wait for very good conditions.And the wind must be from the right direction. It's going to take a long time for that fleet to cross, under sail in light winds. You have to be confident that those favourable winds will stay favourable until your invasion force is all safely landed. It takes a long time (days) to get the army onto the ships. Horse had to loaded in slings, for instance. Think of slinging and loading say 5000 horses! Then the voyage itself may take several days. Then disembarking takes even longer than loading, and is subject to tides. Winds don't usually remain constant that long.
So you must assemble your stores and army in camp, and wait. And wait.And wait. While you army gets restive, drunk, men desert, disease breaks out.
And the actual landing will be chaotic. Sailing ships (especially those undermanned lubberly flat bottomed boats) cannot be kept in any strict formation. So at disembarkation units will be broken up and scattered.Many men and most horses will be seasick (the voyage isn't long enough for getting sea legs).
And all this assumes that there is no attempt by the English to intervene, either at sea or at the landing site.
Generals talked lightly of invasion. Admirals knew better. Really, no one succeeded since the Norman conquest.And only two rulers were bold enough to seriously try - Phillip of Spain and Napoleon (and I guess Hitler in later days). All the others (Philip Augustus, Henry IV, William III, the Jacobite landings, the French landings in Ireland) relied on having friendly forces among the local population. They could send a small force and augment and supply it locally .Not really an invasion, more a cadre to base an uprising around.