Not just him, but also Prince Robert d'Orléans, Duke of Chartres. In the ranks, wags took to calling them "Captain Parry" and "Captain Chatters." But yes, you're right, there was a lot of sympathy for the Union cause in liberal French society.
In our history, Napoleon III dies in 1873. A little...