You could just keep the REQ running and filter out unfollowed people locally.

And when you follow someone and want to load their notes from that same relay you could maybe close the first REQ and start a new one with "since": with the new pubkey added -- and maybe do a separate REQ for fetching old notes from that newly followed pubkey.