To join or support one that, in his opinion, would itself do injustice, would be criminal. He must, therefore, be left at the same liberty to join, or not to join, an association for this purpose, as for any other, according as his own interest, discretion, or conscience shall dictate.