Hi all, I have to disable all video uploads and links for the rest of the month, my data-out was all-time record, 1.7TB /$100 just for today, not sure whatβs up..
Discussion
π²π²π²
Wow
π±
π
Is this something that can be handled on AWS? Are their prices higher?
AWS has cheap hosting, but I think it generally goes against nostr culture to do so. Someone's gotta get paid to host data, but maybe relays like nostr.build could act like the central node for mining pools, where nostr.build farms data hosting out to a keet.io channel that's supported by a number of at-home NASs. Nostr.build could monitize the service they provide by requiring a payment for uploading pictures, and then stream sats to split among the host participants based on who has the data available when its requested. I'm a bit of a keet.io shill, but I think it could help split the load if people are going to be sharing lots of data here.
I could easily give nostr 10tB on my NAS with unlimited data cap, but I'd feel a lot better about running that through keet and pooling with a few others for simplicity and not breaking peoples experience if I have a power outage.
Hmmm π€
nostr:note18pg6dks0qzmd05hcmhx3jdx60a2c5tvkcmppzzgj98hku803jnequ9t7ls
Are prices higher or are people uploading way more? Whatβs the problem here?
Wait i misread that. Your data out is whatβs costing. Hmm π€
I would love running a personal instance so I can host my own stuff.
π―
Oh, fuck yeah. 100% this.
You can do it now, you would just have to copy and paste your link.
Eventually the apps should let you add your own image server.
i think this can be easy be done⦠setup your own imgproxy or picsur server. in #snort i think you can add already your own imgproxy server.
it would be great if the apps allow to add the own server to host pictures.
is theres a way or a hack for people to just make a twitter account and upload videos there but can automatically post the video url from nostr?
ππ€
i dunno im thinkin like https://twittervideodownloader.com/ when you put a twitter link post it spits out the url of the video like this https://video.twimg.com/ext_tw_video/1659279669974147074/pu/vid/720x878/V67ylEAn6N5tY0ZZ.mp4
Do you have a cap on max upload size? Perhaps someone is uploading entire films or something...
Solid π
Shit. Do you have any analytics to get an idea of where it's coming from?
Also β remember to ask for more money. We have to make #nostr sustainable.
Thank you for the donation π
I donβt know exactly, but the more I monitor over time, the more I just think it is normal, growing traffic, and how my infrastructure is currently.. there is no βsingle sourceβ, itβs coming from everywhere! A lot of traffic from
Florida last few days!!
prevent le spam
We'll support you!
May I ask how you've been financing this up until now?
Good question π§
Well for oneβ¦. I bought a premium account on Nostr.Build
Oh I didn't even know this was possible yetπ―
Yeah, a few ways! Accounts and donations mostly.
AWS gave me $1000 grant a few months ago, but only ~$300 left, this month is ~$600, received $150 in Zaps, sold $100 of accounts, I may pay $50-$200 a month depending. I donβt care paying a few $100 out of pocket, I just canβt wake up with $1000 monthly bill π
** we are working on a whole new architecture backend which will be much more cost effective and plan to deploy next weekend. It will fix a lot of things and will absolutely bring prices down.
Then we can move to Podcast Storage and RSS Monthly Subscriptions π€ͺπ
β‘οΈ
Thank you for all that you do for #nostr
Yes indeed thank you for what you have done for the community here, and good to hear you'll be able to decrease costs. Do you have plans to implement a revenue model? Subscibtion proportional to storage used? Or a %of a zap-splits? Are you gathering data on what users would prefer?
Honestly it's totally fine for nostr.build to focus just on image hosting, for now at least. Video hosting can get super space/bandwidth intensive very quickly, so it's best to keep that for when the revenue model has consistent inflow!
If Imgur and YouTube need ads and premium subscriptions to be able to afford video uploads, it's totally understandable that nostr.build would need enough flow from things like that before it can handle video.
Keep up the good work my friend!
Crazy how much you have to pay every month now
Did you implemented some sort of throttling, above all using the single assets as filter? I suspect that native clients are not yet so good in caching, they can fetch the same data over and over.
I think that if a user paid for the Nostr.build, their ability to upload videos should not be taken away, do you agree?
I almost see this as a DDOS attack and is what bitcoin should be able to solve. To protect services and data with the power of the POW network.
How can we help fix this?
Fishcake is fixing it. Load balancing servers with image proxy shrinking and caching from s3. Itβs going to be beautiful and fixes a lot of other problems also.. So many cool things coming to nostr.build!!
Is it all traffic from Nostr clients/users, or is there even a way to tell that? I could see free media hosting being appealing to a lot of people for a lot of reasons.
Itβs mostly nostr because Iβve pushed most clients to the api and website traffic is way down, but there is still a lot of website traffic, but that could be nostr also..
A really cool strategy once we get accounts integrated with the clients, is to push people to the accounts and just offer bare minimum for free, but not there yet.
Yea account integration with clients will be good for sure ππ€
Itβs top on my list, itβs a win for everyone.
We have two new account features coming with the new infrastructure,
- killer new acct dashboard
- api for βcreators page buttonβ (will add a βgifβ button of curated content to apps. 1st step into acct/app integration..)
This man needs to be zapped for all his great work in #Nostr π§‘β‘
OMG all the Zaps rock! Thank you all!! This will literally pay a huge chunk of the bill, incredible, blown away this is even possible.. πππ€π«
Nostr is growing... We're going to need to start to diversify our media upload options such as using nostrimg.com, void.cat, nostrfiles.dev, and good ole imgur.com.
nostr:note1rvgsnsnmnkw3ufr5sxym6jpcdkzk6lxdzahqef7u5lqdwc09rhwqxntkvf
Why not your own Dropbox or mega or google drive?
I donβt know anything about mega, but Google Drive and Dropbox make it inconvenient, if not impossible, to get a direct link to your media. The share links they provide display the media in their own viewer instead of linking directly to the file.
True but there are third party extensions that make that easier
you can, but you'll go through your bandwidth allotment if you have a couple large files and have a lot of followers or popular notes.
wow
zap the media uploaders!!!
Do you see a lot of imagebots in the logs perhaps? Might want to grep logs for user agents. Can block nicely with robots.txt and if bad crawlers with AWS Firewall or WAF. Could be someone trying to mirror content by scraping so look for IPs and rate limit then. Can use https://goaccess.io/ against logs if do not already have something.
Micro-zap payments per upload? Show minimum Sats for image or video with option to add more Sats when upload.
Added the robots.txt earlier this month, yeah, trying to limit all scraping , increased compression an reduced video upload max.
New load balancing arch will likely solve these problems.
Goaccess.io looks perfect. Just point that to my web logs?
Yes, can install and run from command line. Or will generate HTML, json, or csv reports. Is very powerful with a lot of features. If logs big can tar up logs and download to run locally.
So I have essentially a toddler level of understanding how all this shit works, but to echo someone else in the comments, I don't have any problem whatsoever in paying x amount sats to upload an image or video especially if it's already integrated into the process....
#grownostr
You all are fucking crazy ππππ
Probably me sorry.
Holy smoke.
I agree with others. Value for value, a lightning payment to upload a video would be a great feature.
Select file, pay lightning payment, file uploads and link is generated. I would pay for that.
I would not pay a subscription though
What the f? Why do you think this is suddenly happening?
This is a genesis note for me to join the nostr:nprofile1qqsfnz2sqsflkatdssmeztxr90s8xrd7r07xkhfwaa6eu9zkcguljpgpz4mhxue69uhkummnw3ezu7rdwgh8ymmrddeszxrhwden5te0wfjkccte9eekummjwsh8xmmrd9skc64v74m to work on scaling and efficiency problems. Those were simple times π€£π€―
(Felt nostalgic today)
nostr:nevent1qqspkygfcfaem8g7y36grzdafquxmptd0nx3wmsv5lw20sxhv8j3mhq3f29x9