Guards from the tower, IIRC the one you always get is even called 'Tower Guard'. However it's implied not to be a significant force, in the strategy meeting Login mentions having 'a few men stationed there'.
It's feasible that if the battle started to turn they were to light the beacon, kill the Wardens, and attempt to regroup with the rest of Logan's forces.