Not that ridiculous considering hit points don't just represent how much hurtin' someone can take but their energy to dodge, evade, parry blows, etc. I've always seen massive amounts of hit dice as the character evading/dodging attacks down into like...the twenties or so of hit points when they'll actually start being injured.