It's not that far fetched. Suppose Hitler rises to power in 1933. Then he dies, leaving the Nazis in power before he can install the SS. Keep in mind that anti-Semitism was not confined to Germany. Henry Ford was extremely anti-Semitic but he did not order anyone killed, so we prefer to remember him for his prowess to market cars.
So, the Germans build a military-industrial complex but what aggression happens will not be the war we remember. If a fiction author, circa 1933, wrote a story about that described the Holocaust as it happened, the book would be banned and the author's sanity would be questioned. They didn't treat insane people very well in those years.
Hitler is dead long before any war unfolds and he is remembered as the hero who rescued the German economy.