In all fairness the first story is the most famous one and often the only one you get to see as most generic Guillivers Travel's experience, be it a children's book or movie adaptation.
For some odd reason the one story where we normals are the superior ones is the one that gets mostly bandied about.