FYI I created a new Alby account on a different browser with a different email address, it turns out Alby doesn't allow you to insert your pub key, it only allow you to insert your private key and it will then generate the pub itself.

I guess at this point it's an alby issue, I see if I can get hold of their support.

Thanks again for your help.