Remember, if you don't want prisoners but the paladin is insisting, you can always pretend to go along then convince the paladin to go elsewhere while the resident sneaky type shanks them and makes it look like an accident.