If Damus works like all other clients then the followers list is published to the relays and will be found no matter what client you use.

I have personally had some ux bumps switching around clients in the earlier days, but recently I've switched around without problems.