You can follow npubs in shitty relays, that is no problem at all. That is the feature actually. You'll connect to the shitty relays and only fetch the posts from that specific person and no one else.