Paul clarified below, but basically somebody could brute force your private key if you have sent a lot of nip04s.