Vaarsuvius may not be responsible for what the fiends do with his controlled body, but he is responsible for not telling anyone about what he saw in the gate in azure city and at least partially for unintended consequences of that.