The ordinals folks seem to be piggy backing off of the permanence and immutability of the BTC blockchain, but that permanence only exists in conjunction with the consensus rules.

As soon as you start hallucinating new tokens and protocols based on arbitrary data, you've already diverged from consensus and there's nothing permanent to your subjective interpretation of that data.