Yes, you would need a way to whitelist certain npubs. The idea is very similar to Untweeps, where are you can set a time threshold for accounts to unfollow. https://untweeps.com