we can connect to remote relays in anyway we want and fetch data in any way we want, the local relay is just for creating a single place to read from to simplify frontend logic and to make it robust to DoS and attacks.
Everytime we see a note come off the wire from a relay we also record that in the note relay index.