Yes you are right, but 100 sat/vB only means, that there are more transactions waiting than normaly but the blockspace is fixed, and only every 10 minutes there will be a block, so, if they can not wait that long, they have to go to layer2s. And than longtherm, there will be less transactions in the mempool, and the "Magnet" of 1 sat/vB will come back. So 1 sat is the lower baseline for the security of the network in the future. If we let that break, the baseline of the security goes under 1 sat/vB.
High fees does only mean, that the use of the Bitcoinnetwork is overheated. Do you know what i mean ?