Not normal to lose your following list. Your follower list, however, is not a list. It's dynamically assembled by the available relays. So, the counter can change depending on who is online at a time.