You also have to choose to fight when enough people devide that they don't want to extend you those rights.