Even if they've just walked into a Dungeon they haven't finished, doesn't mean they'd immediately accuse MitD of wrongdoing. There's at least three more plausible answers before Team Evil would conclude 'MitD has agency'