remove yourself from the equation
many people spend all their energy fixated on others in avoidance of ever looking at themselves
you have a lot of exposure to the public and therefore have a high chance of being preyed upon by these individuals
trying to work things out with them is noble and courageous
but unless healing the core wounds of all those that got triggered by you is your ultimate intention for the use of your energy
i would practice disconnecting yourself from the person they think they're talking to