I totally agree with you, this solution I have proposed is to avoid headaches with relays and save on battery and data, but the solution is the Gossip model that solves all the problems cited by you.

The ideal would be for me to have my private relay and store my notes there and the client would be smart and be able to fetch my notes from my relay, this would make the network much more scalable.

Unfortunately at the moment except for gossip no one is going in this direction.