Damn!

Double-zapped *again*.

I clicked the zap button, selected the amount and then zeus opened showing the invoice. I hit the big button, then it "fails" after 1m, but under the hood my node keeps trying. I was fooled by this and tried to zap again which also "failed". This resulted in two zaps.

The issue seems to be that zeus displays the payment as failed, but it's not.