Lol. Good one.
The PHB however clears up that this is not what the normal section tells us:"Normally" in the description can only mean without penalty for non proficiency.Originally Posted by PHB p. 89
There is a quirk though. Since the feat does not make the character proficient but only removes the penalty, the character would not qualify for any other feats or classes that require proficiency