The baby armor should act like cover instead of adding AC. Thus you would be unable to attack him without hitting the babies. If the face is described as visible (which it should be), then you could attack if you have the precise shot or precise swing feats. That is, unless something has changed from the 3.5 that I know, as I dont have 4.0 yet.