AFAIK fee estimation is not done solely based on the mempool, also not from core. So this is a strawmen argument.

Also if miners decide to put out of band garbage in their blocks, those blocks propagate slower through the network (as nodes need to request those tx first). This sets an incentive for miners to not mine garbage, as they risk loosing the block race through the network against garbage free blocks.