If it is online, they could send private messages to each other.
   Or they could be members of a group that you are not in. If it
   is in person, they can simply make a look at each other that you
   don't understand that means, "What an idiot!" that they
   understand.

   It happens. Also, in public groups, someone can talk "behind
   your back" publicly by having a kind of 'code" where they are
   making fun of someone in a way that the person doesn't
   understand, but they do. The secret is to understand all of the
   codes, but not let them know that you know the codes.* That
   gives you insight.