They arent getting worse. Lets stop with that. Youre fighting stronger monsters. That is not the same thing. You can invest, as a player, to get stronger in those areas too. The degree to which depends a little on the rules youre allowing, but you can get stronger in them.