The way I see it, is if there is a possibility for either party to feel uncomfortable using or not using a new form of pronoun that doesn't align to biology or the historic norm of humanity, the person introducing the deviation should have to feel uncomfortable, in that situation.
So I often put myself in their place, and if someone calls me a 'she or her' by accident, I would politely correct them and say, "actually I am a 'he'". If they continue to call me a she, I would ignore, or if intentional, think they are an asshole and move on with my life..