I don't know about looseing out on spellcasting just yet. Consider the bard PRC that grants spellcasting 4-9th level. Now you don't care about the loss of the lower level spells so much.