While Goering himself was at the start less anti-Semitic then his counterparts in the party, not to say he was nice to Jews just tolerant, by 1941, the man was a full fledged anti-semite.
I don't know if it's fair to call him an anti-semite, atleast not one on the level of your general Nazi hierarchy. He was an apathetic narcissist who only cared about increasing his own power. Terrible person, but he would have just as easily penned the blue prints for industrialized genocide against any other group of people. Now, what am I trying to get at here, you ask. Simple, with Fuehrer Goering his power becomes more-or-less absolute, probably more so than Hitler's. Hitler couldn't run a coffee shop, let alone a government bureaucracy.
Hitler's Government is something of a contradiction in terms. It'd be generous to even consider it a Feudal arrangement. With Goering at the helm we'll see centralization and consolidation of power. Sure the Jews remain the scapegoat, and many of them die in staged "rebellions" along with anyone else on Hermann's Hit-list, but he's got no reason to push or help along the system we saw developed in our world.
Terrible life for the tons of "enemies of the Reich", but you likely won't see the death-camps.