Again, it depends on whether you think Bismuth was talking about a capability of the sword, or the mindset of the person the sword was made for. It just makes infinitely more sense in my head that it means the latter, because taking away the world's capacity to harm a Gem's gem means you've either taken away its hardness, or made it out of some material that is repelled by Gem energy.