Precisely why it's totally okay to take that nonexistant "right" away to protect one that really exists. Just like a "right" to make pariahs does not exist, and must be taken away to ensure a right to free speech.