While FDR did manage to stay in by sheer force of popularity, it's worth noting that there were hard limits to his power; the court packing scandal was a fairly visible ceiling on his power, and without war exigencies, he would no longer be able to exercise even the level of power he had wielded.