Don't worry. I won't let anyone in that isn't on the list. Did your IRS agent fill out the form and provide their npub? If so, rules are rules. In they come.