If you have the Southerners leave, you could have them also attack the town or village where the PCs are staying. It would be a good distraction to cover their own escape.