Your public notes are signed by your private key, this makes it impossible for someone else, even relays, to impersonate you as they couldn't sign faked events without your private key.