I've had this happen when trying new clients but less lately. I think there are a couple services that let you back up the follows list