People say that like it isn't an absurd statement. "Price" is merely a measure of what you can buy with your Bitcoin. Bitcoin would be pointless if it couldnt consistently buy more over time (a higher price). It has to at a minimum keep up with what fiat can buy. But realistically, most people wouldn't bother adopting it for an equal trade.

Price absolutely matters.