Some of the more sketchy, not updated in ages, clients can wipe the people you follow, but those following you are unaffected.