I'm on the same general wavelength, but people who own a building in Manhattan never sell any of it. They use the building as collateral on a giant loan, live off the loan, pay the interest with the rental income, then refinance it again.
I've never been rich, so don't really know how it all goes, but that is my current plan.
I have written some of it here