Or nothing has to go, because when you censor people you will eventually be the one censored.

Fight or ignore hatred where you see it, but no central authority should hold the power to limit speech. That responsibility belongs solely with the individual, because if it does not then it eventually ceases to exist.