Oh, this is way, way darker than you realize. Hitler basically wanted to enslave, impoverish, and banish the Jews. Do you have any clue what that would have meant in human terms?
1. No Miriam Halpern at Heidelberg means no breast cancer vaccine.
2. No Albert Einstein at the Kaiser Wilhelm means no nuclear power plants.
3. No Harry Klein to emigrate to Canada might mean no Canada after 1975 (that one's close to my heart, I'll admit).
Think of all the scientists, musicians, artists, etc. who would have had the opportunity for greatness stolen from them - and from us. Imagine the great Eva Hoffman digging ditches. Imagine an illiterate Ernst Graf or Anne Frank. Imagine a Kurt Blum who never saw a chessboard.