I can only see that happening if the account you were following was only specifically connected to just that relay which is kinda unusual. However, we have had some "following" glitches between some users that as far as I know you just kinda have to resolve yourself and refollow.