To remove them or not accept them at all?

If you mean to remove them after verification, that’s already the default behavior of Bitcoin Core.