I agree. Nothing in biology is so precise.
Still, there are enough shared anatomical characteristics, that I imagine most people can guess what region of the world most people’s ancestors can from by looking at them.
Race and sex aren’t a 1 to 1 comparison for sure, I am not trying to make that claim, what I am pondering is how closely the link between sex and gender is akin to the link between race and culture.