Atlanta would be the more logical solution.
In fact a veteran AH Story about a Southern victory in the Civil War written by Carole Scott in 1997 say:
"
Because adequate accommodations were not available in Montgomery, in the Confederacy talk of establishing a permanent capital elsewhere began almost immediately. Selected by President Cobb to fill a post we would today label Chief of Staff was General Joseph E. Johnston, and he, along with several others, including Senator Judah P. Benjamin, who were possessed of influence with him, advocated that the capital be relocated in Atlanta, Georgia, a city far more defensible than, say, such vastly larger cities as Baltimore, New Orleans, and Richmond; yet better able to meet the needs of government than tiny Montgomery. Therefore, when the Confederacy was only four months old, its capital was transferred to this modest-sized, but rapidly-growing rail hub located deep in the heart the Confederacy's bread basket. [Thus did the forecast the late John C. Calhoun had made when it was but a tiny rail junction that, because of its temperate climate and location, Atlanta would someday become a great metropolis, begin to come to fruition.
Cities such as New Orleans and Richmond were like spiders sitting on the edge of their webs, while Atlanta was like a spider sitting in the center of its web. A further advantage of this often criticized selection was neutralizing the Confederacy's most obstreperous governor, Joseph Emmerson Brown, who threatened to become a real thorn in President Cobb's side. Putting the seat of the National Government in his State reduced his power to little more than that of a caretaker. Although he objected to sending Georgia troops and Georgia equipment, such as railroad engines, out of the State, he was unable to hinder either action. Perhaps, more than anywhere else, Atlanta's selection was applauded in tiny Milledgeville, Georgia, because making Atlanta the nation's capital appeared to doom the movement to transfer the State's capital there.]"
link to this interesting AH story (an also as you will see a similar although different civil war -Lincoln death in an accident, Jefferson Davis is not chosen president, instead of this is Howell Cobb, etc-)
http://members.tripod.com/~car0lesc0tt/clopton.html
Carole also has an interesting page with short but interesting biographies of politicians, generals and antoher important southern people of the XIX century.
http://members.tripod.com/~car0lesc0tt/figures.htm