They charge for their own hosting of their open source - yes.
And yes I am new.
But these people are taking about their eNcRyPtEd AI hosting. But like… no wtf. If I need a TRUE private AI solution I have to have my own inference.
You can’t say “company A has your data so use us instead”
The real solution is self-hosting - not trusting yes another company that promises some “encrypted” service. Encryption is ubiquitous, and so is data mining. 🥱
Yes I am new, btw.
So new. The newest.
No one is newer than me
Don't come in hot then on people providing a service that people want just cuz you're not their demo. Do I want to run my own models, yes. But the 1070 I have won't even be able to run anything better than glorified man pages. Do I want to buy a new one, sure, but for now I'll use private services like this over ones I know are collecting my data
You’re sending your data to this company and assuming they’re not collecting it, first off.
I’m not coming in hot for saying that - to a nostr/bitcoin crowd we should all understand “not your keys not your coins” as well as “not your computer not your data.”
They are also advertising their “encryption” ffs. Which AI company DOESN’T use encryption? That’s straight up either bad marketing or they know most people aren’t smart enough to not fall for it.
Go buy a Mac Mini with 32GB of ram and you can run a ton of LLMs at 40+ tokens/second and do image generation
I think you need to scroll back through this accounts posts. They have clout on nostr as Cypherpunks, it's literally a business their wallet was one of the first with nostr integration and was highly regarded, I could continue.
It’s like you just told me to check out a PoS coin… answer is no, by default. PoS is the problem. If people are uncomfortable sending their queries to OpenAI, at al, then using this company solves nothing. I can’t appeal to the masses just because the “nostr” crowd likes them. It changes nothing.
A company telling me to use them because they are private/encrypted (which is unprovable) will always lose to private AI inference - which isn’t expensive to do (less than $500)
I am completely onboard with spinning up an AI company, having people pay in bitcoin/ecash, and having all my users be anonymous. I want to be clear.
I am working on exactly this.
I want my users to be random npubs, pay with cashu and be comfortable with the fact that I can inevitably see all their queries… but don’t know who they are - unless they dox themselves in their query. I have no interest in snooping their shit, but obvi I can’t help but have the ability to see it all.
It is foolish to think an entity you’re sending data to won’t or can’t parse / retain it.
I need my users to deeply understand this. I can’t tell them to not worry cuz I use “encryption.” Just use my service and don’t send anything you can’t tolerate getting out. For secret stuff you should always use truly private LOCAL AI inference
nostr:npub1az9xj85cmxv8e9j9y80lvqp97crsqdu2fpu3srwthd99qfu9qsgstam8y8 has mentioned this problem with his own unleashed.chat.
