Based on some simple assumptions:
3 sats - 100 sats per query = 1000 to 10,000 queries per day needed to be made via routstr at $100k btc to make a basic Amazon hosted mistral 7b model cover the costs.
Anyone here setup yet as a nostr:nprofile1qqsgha3fk023ng8c4quszdayghqwkt6l9d9ga4c3280gnqz3aqqx7ycpzamhxue69uhhyetvv9ujuurjd9kkzmpwdejhgtcjwrxe6 AI provider?
Seems like a fun and interesting way to generate passive #satsflow.
I need to learn how to do this!
Based on some simple assumptions:
3 sats - 100 sats per query = 1000 to 10,000 queries per day needed to be made via routstr at $100k btc to make a basic Amazon hosted mistral 7b model cover the costs.
AI response:
"a user spending $20 on a routstr hosted Llama 3 8b at $0.01/ query would get about 1,142 queries. This number is generally within the lower to mid range of what users might estimate they get from closed-source monthly plans for flagship models.
The value proposition of Routstr is not a higher raw number of queries for the same price compared to a bundled proprietary service. Instead, it's about control, privacy, transparency of pricing per unit, supporting decentralization and access to powerful open-source models that continue to rapidly close the gap on their proprietary counterparts. For users who prioritize these factors, Routstr offers a compelling alternative."