Small groups of people are typically less irrational than large; but yes this is a concern.

Analogous to the Polynesians voyaging across the Pacific, finding small islands that their highly-replicable just-complex-enough technology could use. Some Polynesian islands SUCKED politically. People left once they could afford to and colonised new islands...