What are y’all using for your private, mobile AI?

Reply to this note

Please Login to reply.

Discussion

are for mobile What AI? private, your y’all using

Ollama with open-webui with mistral as my preferred model (you can download all the open sauce ones with ollama)

On mobile?

Oh no, I just use mistral.ai or trymaple.ai on mobile.

I was just thinking laptops are mobile so technically that answers the question lol

Using the same combo. Its on my umbrel, reaching it through clearnet tunnel.

Probably a good idea to run it from a server. I just run it locally on the computer itself.

I can use it from anywhere. I dont know if its good or bad. 😅

I definitely feel safest just having some things run locally. I like my way best lol! But I see the utility in that way of doing it.

What’s a use case scenario you’re looking to solve with this private, mobile AI?

Like not giving some corpo all of your chat history? 🤣

Yeah they're good

But y account? Should add anon sigs and pay as you go

Yeah that would be great. They probably will soon. They're the same guys who made Mutiny if I'm not mistaken. They have experience with lightning, should be almost trivial for them to add that as an option.

Why do they require an account …

The only 2 that come to mind for that are Unleashed.Chat and I think nostr:npub12rv5lskctqxxs2c8rf2zlzc7xx3qpvzs3w4etgemauy9thegr43sf485vg reposted someone who is using OpenAI with a Cashu Token for API calls, but you would have to build the interface for that I think

Venice.ai

Ppq.ai without account and paid in sats.

I'm using Claude, with a alias mail and a anon credit card. And are the only AI app that works without a Google account on grapheneos.

Ollama seems decent to run isolated models