Assuming his brothers come to sticky ends as OTL, that will leave only the Balliols as a rallying point. And once Edward I dies they more than likely win.
An earlier PoD would be for Balliol to not be deposed or even if he marries Margaret the Maid of Norway(this is the least plausible scenario and Margaret might still die like IOTL).