One thing to consider is how to set the LA with the first place. CR is not level. HD is not level.

Heck, the CR for an archmage (casting 9th level spells) varies from about 4 (if no significant combat spells prepared) to about 16 or so, depending on what he has prepared.