See, in my opinion the problem with LE is in the difference between it and LN. I often see Neutral people as being lacking in morals, though not explicitly evil. For example, let's say I have a character who has no qualms with killing someone if he thinks it's a good idea or would lead to his own personal gain. However, he will not torture people or draw out their death longer than necessary--he will kill them quickly and efficiently.
Is he LN or LE?