Despite (or maybe because) of my severe arachnophobia, I feel wracked with guilt whenever I kill a spider. So there doesn't strike me as anything remotely unusual about feeling bad about killing a mouse.