All true.
But I still don't think he is doing the right thing, and I fail to see what "evil" the Empire has done.
Of course it all gets muddled by how you play your character anyway, I have found it funny (not talking about anyone on this forum!) when people argue for the virtue of Ulfric (and the oppressive evil of the Empire) while themselves playing a member of the dark brotherhood, for example.