wss://archive.orly.dev/ now contains some 480gb of events:
root@cuddly-anteater:~# du -h -d1 /home/mleku/.local/share
4.7G /home/mleku/.local/share/archive-relay
long way to go yet. i know that there is at least somewhere near 200gb of nonsense in total.
i dialed back the speed of the scan for past events, so it responds decently for queries.
the price of a server that can do this has dropped a lot. i'm glad because in my visions of future internet there was archival nodes like this.
history matters, especially for #WoT stuff. with a decent history to work from you can increase the signal more about the behaviour of users on the network. it's quite trivial to both keep up to date and continue to accumulate as much history as possible.
i need to look into how to turn the archive into a secondary data source for wss://relay.orly.dev/ that would be very cool, but needs some thought about how to implement it.
i've done a bunch of stuff lately and felt lost for something to do but this is a good one. enhance a regular relay with a size-limited database store with second level fetching.