The claim you made was that hate harms the hater more than the hated.
And I would say those different motives are just as relevant. My position is that if someone is driven by some motive to commit intentionally harmful acts, then the motive is also implicated in the harm done, because the acts are an expression of the motive.