You are fine so long as XMR doesn't go up in value vs the USD but as we've seen even a loaf of bread goes up in value substantially vs the USD.
The IRS will be used as a tool to make your Monero use less sovereign. You will be forced to reveal all your transactions to them under the guise of tax collection.