We aren't told.
The army camp is off limits to you in the same way, and you're not told why there either, as are the Kokari Wilds (though you are allowed into the Wilds after Duncan gives you orders to go there). I don't think you can go into either the army camp or the Tower before the big meeting.