The Armored mage ability (no ASF) only works for spells from your duskblade side. I'd recommend Cleric since they can already cast in armor. This will introduce a little bit of MAD, but if you focus on Int and Wis, everything else can easily be bumbed by spells and items.