Sorry left out the main part. You lock the payment for the others public key, so it can only be unlocked with the corresponding privatekey. So in theory only the other person has access to it.