I would make them get spells like a Wizard, they get them at will so it's pretty powerful already. Maybe powerful enough to make being a warrior a bad choice. 2nd level spells at 3rd, 3rd level spells at 5th, etc.
Also, many high-level spells rely on the user having a high caster level for most of their effects. There's also the issue of saving throws.