the difficulty adjustment takes time... that was part of my argument... if calculation activity drops the blocks take longer to calculate and the difficulty adjustment takes longer to occur
If discovery of new tokens is slightly unprofitable, transaction fees will take up the slack and difficulty will adjust over time. If discovery is tremendously unprofitable it can exceed the tolerance for users to pay the higher transaction fees.