1) I agree with you completely.
2) I think people are often upset when people try to ignore the XX or XY biological reality. Or try to force / coerce others to use certain language (pronouns) or use a threat of violence if you “misgender” them. This is strictly not libertarian.