The same thing happened to me, so there's definitely work to be done with key management. It was a pain to figure it out. Alby's user experience has a lot of room for improvement!