There are a lot of different reasons for why one number would be showing up on a die more often than others. It could be that the die is simply balanced improperly, for example.

It could also just be confirmation bias. You expect the single die to roll a 5 more often, so you take notice more often when it does, and less often when you roll it with another die.