I think the damage reduction from rage, for you 2 rages, is huge.
It's all damage but psychic.
For me your big deficit is the same for all fighters... wisdom saves. Resilient wisdom coupled with indomitable is nice.
A dragon who hits you with frightful presence... takes you out of rage most likely unless you have mooks to fight... then breathes his flame.