Correct.
Taxes act more like a brake on inflation by attacking the purchasing power of citizens, purchasing power that would otherwise place (rightful) pressure on desirable goods and services.
They are used to draw down the debt, too.
Without taxes, inflation would "register" much quicker.