Yes, but not really, if a list gets leaked with holders physical addresses, and it's a significant amount, eventually there could be hired goons to coerce...

It could be good op sec to move physical address regularly