You underestimate the capacity of “toxic” people (psychopaths, narcs, whatever term makes you happy) to silently recognize each other and gang together when their interests align. Research shows that they can identify each other in a crowded room without having to communicate.