For example, which of the following would be correct?
  • I can not run, let alone walk.
  • I can not walk, let alone run.

My instinct is that "let alone" means "not even this one/simpler thing", so the first sentence is correct.

However, I have seen the expression being used the other way around.