Whatever it's other points, the V2 was incredibly expensive. I've heard it said that the program overall cost half as much again as the Manhattan Project, despite the fact that the WW2 German economy was much smaller than that of the USA. It also consumed a large portion of fuel alcohol production, as well as the scarce strategic materials that were desperately needed in other sectors of the German war economy. Given their effectiveness, one can't help feeling they were at best a waste of time and resources, and possibly actually a hindrance to German efforts.
So what would happen if they weren't built? In 1941 Hitler wasn't very impressed with them, stating that they were merely an artillery shell with a long range and much higher cost. Suppose he keeps that opinion, and refuses to support the idea. No doubt the program will limp along, but it's hard to see it getting much further.
To me, a more interesting question is what will the Germans do with the resources that IOTL they poured into the V2? There's not much steel to be had by reassigning those resources, but plenty of other materials. More aircraft? Better jet engines? Improve the V1? Something else?