Janick didn't hear it. It's hard to show using just the words that all the Pokemon responded at once, but they did, and so Janick didn't notice. Sir Misery just didn't feel like saying anything about it, because "We're with you" sounds more impressive than "We're with you except for that one guy who hates you".