A client could ban a pubkey from using their client but then you could just use a different client or copy your account to a new pubkey. Clients can’t change or remove your data, it’s all backed up across multiple relays which are owned by different people. So all relays would have to collude to remove you (has never happened and probably never will), even then you could just run your own relay.