Proper Reaction to Charm Person.

[Sigreid]

These are simple people that do not know magic. It's all the devils work.
Or they are people who understand magic. Then they know this is a charm spell.

I think in most D&D worlds the average person would know that magic just is, even if they don't understand it.