Did you just change it? Clients keep info like your LN address in their cache and don't always check if it's changed every time someone zaps.
Discussion
I changed it yesterday, then it worked, cuz I received some zaps. And now I get notfied from #wos that I received a #zap 15 minutes ago. Must be something of different clients indeed