The web once was mostly text, and it still had only handful then only one search engine... The web is huge you can't crawl it cheaply even if it was only text.

Yes someone can do the indexing and sign it and share it, but who cares, how is that different from visiting a website, the index remains centralized and thus the Indexer will both comply with censorship AND look for ways to make money to offset the cost... That is also ignoring personalisation and suggestions entirely... Just a dumb index.

Again, someone has to download the data to discover it ... And that can't be made cheap

Reply to this note

Please Login to reply.

Discussion

Best possible option is to let millions of people crawl small parts of the web, index them and generate a ZK proof of that and get paid for their work _somehow_ then share these parts with each other in some sort of a DHT.

However, a centralized indexer will always be 1000000x efficient because zk proofs are expensive as fuck.

Even then I don't think this will work well at all.

It is much easier and cheaper to just pay someone for a high quality aggregated feed