A wizard with time to prep can set up multiple glyphs of warding that cast mind blank in a demiplane. That solves all of the domination/psychic damage issues.

Wizards and Paladins are very useful in this circumstance. This could be a blast to do. Someone might die in the end but I see the colony going down.