if you unfollow on any One of those and wait a while before trying the same on another, this keeps happening? like no matter which client you initiate it from?

Have you tried coracle?

Vitor had mentioned to me before that it can be a relay issue. I have no clue how that works, but was mentioned to me because when I would update amethyst I would loose follows and #s I was following. Way outside of my wheelhouse though. Maybe nostr:nprofile1qqsyfhqu9kuu877hhm5j2lkwk5478nuvgza00d3lgmjkkk9px8r57zcpz9mhxue69uhkummnw3ezuamfdejj7qgmwaehxw309a6xsetxdaex2um59ehx7um5wgcjucm0d5hszxnhwden5te0veex2etvv9ujuum0we3xjapwdphhxap04vlpvm would know