Nostr Web Client

Data storage is not the only issue, a bigger issue is censorship on ISP level, a wireless mesh network could help with that. For data storage, well I don’t think you can build a decentralized data center with zaps :) For file storage, I don’t know, maybe a small device that you just plug in, which runs its own IPFS node to store and distribute your own files?

CensorThis 2y ago

https://ankush-chavan.medium.com/twitter-data-storage-and-processing-dd13fd0fdb30

Although one tweet consists of a 140-characters message, it is seen that Tweeter generates more than 12 terabytes of data per day. That equals to the 84 terabytes per week and 4.3 petabytes per year.

Reply to this note

Please Login to reply.

Discussion

CensorThis 2y ago

Twitter is making efficient use of BigData concepts. The first technology that Twitter uses to manage the data at a large scale is the Hadoop. By means of Hadoop, Twitter is using the concept of Distributed Storage. Hadoop clusters are running both compute and HDFS(Hadoop Distributed File System).

Twitter has multiple clusters storing over 500 PB of data. The biggest cluster of Twitter is over 10K nodes. Twitter runs 150K applications and launches 130M containers per day.