It's worth remembering a lot of Western folklore was influenced by Christianity. A lot of traditional monsters that were in the vain of "you can't really do anything about this; they're manifestations of nature, death, injustices, and other things we have no control over". Then they got switched up to fit a newer "there is, in fact, an all powerful God who can put a stop to this nonsense" paradigm.

Hence why a lot of ghost stories involve "holy symbols" -- which act like they have the Abrahamic god behind them, even when they're from some other source of faith (as an aside, I love it when ghost stories take the idea it's any sort of faith that works, rather than anything external).

There's still a lot of very much invincible monsters in Western folklore, mind you. For example, if you were to meet the Nuckelavee (cw: skinless humanoid) on a dark Scottish shore, you have as much chance of beating it as you would slaying the sea if you were swept in by a wave.

Japan just applies the same logic to ghosts; the evil that created the spirit is done and dusted. Society just has to deal with the aftermath and hope for the best.