Seems complicated, where does this person get the access token?
Why not make it public to trade a nut for a Lightning invoice but not for a nut swap?
Or if for a nut swap, then only for a nut that is marked as withdrawal only. Also one that is clear for any reciever to identify that it is a withdraw only nut offline (so they know they can't prevent a double spend and so they shouldn't accept it)