In gendered languages, (non-human) objects have genders too. Non-human objects cannot be men or women. Thus, the words "man" and "woman" do not refer to gender.

If you think you are a transgender woman, you are actually a transgender man who thinks he is a woman.