I force closed the app and then came back. It was gone and then appeared again. Force closed again and now it seems to be gone? 😅 I’m guessing it depends on the relays and if any relay I’m connected to still has it then wouldn’t I still see it, even if some delete it?

I think it still depends on whether a relay supports that nip as to whether the delete request is honored on that relay. I’m not 100% certain on that but I think that’s how it works.