Not sure what’s happening with the unfollowing but you’re likely seeing ppl you don’t follow because you’re following hashtags they’re using.