I've probably said this before, but this seems like a good place to use (a network of) caching proxies for reads. I wonder whether software like Squid could be adapted to our purposes?

There's also the old NNTP model, but all that storage space and indexing was really a bitch back in the day!