If that's not fixed on the main layer, it could lead to centralization, as only large institutions with significant Bitcoin holdings would afford to transact there. Self-custody would become increasingly expensive, eventually pricing out individuals from paying transaction fees.
Not a real threat today, but conceivable in the distant future.