I think I found out the reason. People following me on Iris but not on Damus, accordingly to Damus and coracle.social, are not connected to any relay at the moment, although seams odd.