What if the EXP that you don't gain is directed into a pool similar to the Artificer's Crafting Reserve, which you can use to provide some sort of bonus on your crafting checks, or to give the items you craft some kind of bonus such as turning a shortsword into a +1 shortsword. (And before someone says anything I'm aware magic items are generally rare in 5e, but I needed an example)