By the way, I'm no vet but you should be OK using the manure.

If I remember my history ivermectin was developed from a bacteria found in soil by some Japanese researchers.

So I can't see any residue causing an issue. If in doubt plant non contact veg such as peas beans etc in it for the first year.