While it is true Yathrib is the minimal amount, that is probably unrealistic.
Supposing the Byzantine and Persian forces had defeated the Muslims, the minimum expansion would be Arabia, except for Yemen and Oman (which were parts of Persia), and perhaps a small portion of the East African coast.