All the times I and other people I know have been banned it is for having opinions that someone else wants to suppress.

This is not a minority thing.