It will mainly be jurisdictional but there are some structural constraints. Here is a quick article that, although not comprehensive, gives an idea of the challenges.

https://www.pbs.org/newshour/economy/analysis-heres-what-it-would-take-to-turn-empty-office-buildings-into-residential-housing