For sure. I'm totally ok with that. I just have issues, both mechanically and thematically, with base smite being a spell.
Not something I'd thought of before now, but certainly intriguing. You'd need a really kind DM to allow it without complications, but I quite like the concept.