Exactly!
We've been avoiding debt and have literally lived with four in a 28 m^2 container-house (that I built on our farm) up until now for that reason.
We're only going (slightly) bigger now because we want more kids 😉.
Having the full fam at home + tight knit small village + amazing food + strong marriage. Beats the rich, materialistic, vice-ridden city life every time.