the Whitworth had reliability issues, and of course was a bit more expensive as it was imported (shipping costs) and even more so for the Confederacy (extra shipping costs for running the blockade)
a bit on it here
http://www.civilwaracademy.com/whitworth.html
Early breechloading guns had a significant failure rate compared to muzzle loaders. Note that the RN went back to muzzle loaders in the 1870s before finally re adopting the more reliable breechloaders available in the 1880s. That failure rate was more serious for naval guns, because either higher velocities or bigger projectiles were required to penetrate armor, and the muzzle loaders were better able to handle the greater explosives forces in the chamber (or breach).
Note that the British Army phased them out and went back to muzzle loading weapons until around 1880.. High intensity fire caused the breech and weapon to get hotter and hotter this increased the chances of premature detonation in an intense battle. As high intensity fire is normal in a large battle, this could be a problem which meant that soon the breech loaders would have to slow their rate of fire significantly compared to muzzle loaders.
As land battles restricted artillery to line of sight (no system for directing or calling indirect fire existed) the effective range was restricted by terrain to the extent that maximum effective range for the weapon mattered less than maximum effective spotting distance.
The reason that the breech loading mechanism had a high failure rate because it was still in the early stages of development. Once it was better perfected, the British reembraced, as did the US Army when Congress finally let them spend some money.
the Krupp artillery had metal cartridges and for the same reason metal cartridges were eagerly embraced for small arms the artillery men loved then. They had a better seal than previous weapons (which used powder bag charges and separate shot) which reduced the stresses on the breach (more of the power of the explosion is focused forward for one thing) and they are far easier to handle. Note that this type of artillery did not see service until 1863, and the Prussians only ordered 300 initially to try it out.
So although revolutionary, and a hell of a weapon, a reasonable artillerymen would be a little wary of buying large numbers of untested foreign artillery in 1864 (as they are still basically in trials) and by 1865 the CSA couldn't really get enough past the blockade to make a difference while huge numbers of muzzle loaders are in US Army service and thus buying a lot of new guns at that point would have been a hard sell in Congress. Especially since the war was OVER in April 1865. As the US Army at this point has literally thousands of guns, and the Navy thousands more, replacing them at that point would have been a huge expense
nice little article here on all of that
http://www.globalsecurity.org/military/systems/ship/new-navy2.htm
Now if the war had come a bit later, I feel reasonably sure the Union at the very least would have bought large numbers, or bought a few and copied it if possible. The Krupp C64 in particular was ideal for horse artillery
https://en.wikipedia.org/wiki/C64_%28field_gun%29