Even if fiat died, the "price" of Bitcoin would be set by a market of goods and would absolutely matter. No one would give a fuck how much Bitcoin you have in the absence of a price. Price is value. And it has to keep going up in fiat terms to at least match inflation. Otherwise, it fails. To say that doesn't matter is just retarded.