If we go by that mentality, then the leadership feat could produce armies upon armies of people. Considering 20+ a mob sounds like it's more for the sake of the Dungeon Master organizing large riots or situations where a war is breaking out, not something to apply to potential party members/followers.