All you have to do is say, "I'm magic!" and you're good.
It's REALLY easy enough to fluff them as racial spell-like abilities, or as mind magic, or as sorcerer abilities (and all the fluff THAT implies). You just have a slightly more efficient way of casting your spells (in that they don't need goobley-gunk, silly little dances, or a rousing rendition of "I'm a Little Teapot").
Basically, it follows the majority of non-D&D fantasy books' version of magic REALLY closely. At least, the books I've read.