Well, that's because only you were outed for the baner to protect, now there's you andGrimmGrue. To do what you've thought of I think I'd have been better to keep quiet about GB for another day. That way you'd be likely to be baned again and wouldn't have to worry about that.
Edit: Note, the main reason I claimed is because I think the villagers shold be aware that they're risking the seer, not possibly the fool. That changes things.