well to be fair spell pouch isn't infinite like some magical arrow quivers. the materials are so common and so cheap keeping track of them would be a nuisance. if a caster was in an isolated environment for an extended time the dm would be well within fairness to begin saying you run out. it is also used a lot in monsters for whom it would be strange to carry a pouch or have anatomical reasons not to wear one.