Actually, that number is closer to 200,000. As only 338,000 were evacuated from Dunkirk and of those, over 100,000 were French who were returned to France within weeks. Grand scheme of things, I don't think it would have had too large of an impact. Probably see less British involvement in Torch, maybe the Americans get another beach on D-Day.