It takes a long time for them to validate a new block, because they have to fetch all txs that were filtered from peers.

https://github.com/bitcoin/bitcoin/pull/28233 should help mitigate this.