Absolutely. I have a bunch of hobbies I do with folks I don't know well outside the hobby. But ultimately they're just someone I associate with for the hobby, just like I associate with coworkers for my job.
Of course, my ability to tolerate annoying people depends on how much I'm getting 'paid', in Money, a sense of accomplishment, or fun. But my hobbies only pay out two of these and the fun one tends to go down with annoying people.