My first thought would be that if they stopped direct taxation, it would too clearly reveal the real game being played. Middling people might ask "if they don't need my tax money, how will they pay for muh roads?"

People who claim to have boundless creativity can't fathom a world where you can get from your home to someone else's home without a conduit built by thieves.