Actually, with a POD a few years earlier the generall situation could perhaps have been suitable for a union.
If the Danish Prince Christian August had lived to become Swedish king, it is not hard to envision a "more successful" SWE-NOR union, and when Frederik VII dies without an heir in 1863...