Older non-outbox client would be unable to follow the links in your manifest. They only read from the relays that the user preconfigures.

If they could follow the links in that manifest, that's already 90% of the outbox model. The remaining 10% is to just find out which relay the user is using and get all their posts from it, no manifest required.