Fees are not affected by the profitability of mining, but the other way around.
Your theoretical point about the difficulty adjustment is interesting. In the case of a sudden -99% drop in hash power the very beginning of a new period, the difficulty adjustment period could go from 2 weeks to 200 weeks. That’s interesting to imagine but it would just cause a backlog of transactions that would make each block more profitable to mine, incentivizing new participants to come in and mine, reducing the block time. And all of this would of course resolve itself when the adjustment period finally ended.
A super massive -50% drop in hash rate would only double the block time to 20 minutes and the period to 4 weeks before adjusting the difficulty.
This is a really interesting thought experiment, but like many things in bitcoin, it seems mathematically improbable.