That's what I've worried would happen. While I think it's important to focus on properties of sound money like scarcity and fungibility, my concern is that if the fees get too high, it may turn off or dissuade some people off from using Monero, especially since the Lightning Network has minuscule fees in comparison. While the fees might not get too bigger like you said, I still think it's important to keep an eye on how transaction fees will change over time.
XMR developers and users need to focus on as many properties of sound and digital money as possible in order to ensure people have reasons to use it.