To be fair to John Breckenridge, he wanted to sit out of the war in neutrality in Kentucky.
Northern and Southern firebrands were determined to fight and he could do nothing to convince them to settle the dispute without conflict, so he left Washington and went to Kentucky, where he tried to convince his fellow Kentuckians to stay out of the coming war.
It was not until Kentucky's neutrality was breached, its government picked a side, and the Federals started arresting Kentuckians who sympathized with the South that Breckenridge decided to join the Confederacy.
Breached BY THE CSA and then he joins the CSA? That's a funny sort of neutrality...
What would you say of a Belgian politician who wanted neutrality between France and Germany, but once Germany invaded, joined the German side?