The problem of elehpants in Iberia is that the terrain isn't very praticable for them.
Don't forget that the mountainous terrain of Iberia (except maybe for the southern 2/5) would likely avoid an efficient use, aka in open field. Plus, even if the southern part could have elephants, these regions are an open door for northern raids, invasions etc, and any power based, or having holdouts in southern Iberia would more need cavalry to pursue foes than elephantry.
You'll say that you can have two or three states in southern Iberia that could use elephants, but even not regarding the need of protecting from northern attacks, these states would be likely too small for entretening a large enough elephantry for war.
But maybe for prestige, shows, parades, some elephants can be acclimated to southern Iberia.