Try clicking on the follower list and wait as it populates. Often its waiting for data from relays and follower number really hasn't changed