I believe it was best stated by the second poster in the thread.

The person who saw you cast it on them, even if they interpreted what it was, would think that it was their friend that cast charm person on them.

"They cast Charm Person on me because it was necessary. Afterall, my friend wouldn't cast Charm Person on me if it wasn't, right? He's my friend afterall."