Incorrect.
The layers of government bureaucracy and taxation factored into building one house is insane. And the zoning laws are designed to make things more expensive to get more tax.
Fox the money, remove the bureaucracy, and I could build you an offgrid house for 10k tops.