Read "The Trouble with Ted" here. It says practically everything you need.

Essentially what it says is; talk to the guy. Tell him that he's not helping anyone have fun but himself, and by doing so he's really being a bit of an ass. If he can't see the light, try to give him some chances in the campaign to sow some dissension outside the party. Maybe the peasants under the sway of the BBEG can be incited to riot, or his minions can be played against each other. This oppurtuniy to exercise his chaotic nature might get the urge out of him.

If that doesn't work, see if it's bothering the rest of the party. If they don't mind the conflict he's causing, then you may need to change your way of looking at it. These problems don't "appear by themselves" as you say; someone does need to start something. Maybe what he's doing is exactly what your other players want. If that's not the case, and he just can't stop give him an ultimatum, then kick him out. You may not want to do it but if he can't play in a way that's fair for everyone, you don't want him in your group. Do it politely; explain that it's not his fault, it's just that your group doesn't want that. Don't lose friends over it, but don't let him continue to ruin your fun.