Observing their movements, we see how they train their recruits, it might've been cold feet for them not seeing their true nature for their dark plan. You got to put the warriors to sleep and take out their weapons and gear with you so that they won't get to fight back.