The idea is good but it definitly should be a template. also the negitive should only affect dealing with people, because charisma is also how likeable you are, i have cousins with autism and the are adorible. i think that you should impose penalties on just bluff but not on diplomisy, because from my experience my cousins can change people's dispostion quite well.