You could argue that it's a violation of human rights. Freedom of speech holds for both sender and receiver. Banning the sender means that, even if you wish to punish the sender, you violate the rights of those who choose to receive.
On the other hand, individuals who wish not to hear said receiver, can already individually block the sender without violating sender's rights in the process.