Let's not discount Edward's potential siblings!
But yeah, he if he was just talking about himself, Tedd, and Grace he'd have likely used household instead of family. He's including Noriko at a minimum, and while we have no idea how wide a net he's casting he's from a line of powerful wizards and his wife's from a family of monster hunters. Both lend themselves to stubbornness.