Sorry to say, but there is a spell that gives the benefit without the drawback. (official feat. I think in races of the dragon.)