It'd be similar to authorizing other keys to send messages on your behalf. The sender would have to encrypt the same message for each of the authorized keys. Otherwise, it'd be a similar problem as private groups, which could involve a reusable shared key itself encrypted to each authorized key.