Well, the average monster has a to-hit bonus of at least 3 + level. At high levels most level-appropriate encounters wouldn't be able to hit the PCs.

Now, you could make this work if you banned all flat-bonus items. Say, "okay, you get utility items that do unique things, and you get flat to-hit, save, and AC bonuses to compensate for no magic weapons and armor".