Detrimental effects on yourself? Mostly none, unless you're using home-made potions, which can occasionally have side effects if 'poison' is also mixed as part of it.
Which can help if you're a Blizzard caster and you want lower frost resistance.
Homebrew Please feel free to PM me any thoughts on my homebrew (or comment in the thread if it's not too old).