If they are truly rights and not entitlements, then they can neither control or be controlled. You may choose to assert them or deny them, and others may attempt to influence you, but this is control of a right, just control of yourself asserting that right.