This was going to be the example that I brought up.

While not exactly leaderless, Pre-roman Europe was very decentralized and was mostly organized along family /tribal lines which seemed to work really well for quite a long time.

If there must be leaders, keep the groups small and very local.