Because of the Cantillon effect embedded in our Keynesian world, the people who are closer to the money printer buy up all the assets ( house) included thus driving the prices and making it not affordable for poor people.

We can aspire to have what you are saying but sadly not possible in this world that we live in right now.