Nope! You just need to sign in with a NIP-07 extension (Alby, nos2x, NoStash) and you’ll be able to create a follow list backup (so you can restore if necessary) and then you’ll be able remove them in batches or even wipe them all out at once.
Trust me, that’s fun!