It wouldn't affect the majority of the npubs that I regularly follow. Those would continue to be relayed from my own relays even tho most of them don't even broadcast to my relays.