You can use them, once they leave your party the orbments will return to your inventory, including the ones they originally had with them