Depends on what node you're running. If they tried, they'd hard fork off for sure, but a non segwit node would allow it. A segwit node would not. Most people run segwit nodes. Segwit nodes are consensus. In particular, segwit nodes are social consensus.

So, segwit is Bitcoin. That's how social constructs work.