I’d be interested in seeing how you approached the crawler code too. I’m prototyping something similar to take in a relay list and a query and process results. Effectively like a crawler - but conscious about causing excess reload load, reusing relay connections, throttling requests, etc.

I haven’t seen any specific crawlers that exist yet - but I’ve heard of a couple being worked on.