Feels almost incredibly hard to swift through everything, even just to get embeddings of everything without classification.

Even Twitter / grok can only do work on your own social graph afaik. It would either need an insane amount of money / compute or a few more years but maybe I'm wrong and you can get away with just crawling through some popular npubs and you're good.