Replying to Avatar feline

I don't think there is anything similar like umbrel for ai stuff. But anyone can install ollama on ther desktop and try things out before deciding between upgrading their GPU, building dedicated server with multiple GPUs, or just pay for AI services that support API call.
Avatar
NotBiebs and 69 others 1y ago

my macbook is old and can barely run the primal web app. so i doubt it would be good enough to run anything. 😂

Reply to this note

Please Login to reply.

Discussion

Avatar
feline 1y ago

Depending on how old it is, the best thing to try now is to install ollama, try a small-ish model such as phi3-mini, and see if you like it

Avatar
NotBiebs and 69 others 1y ago

i want to use llama 3.1 with 405 billion params though 😂

Avatar
NotBiebs and 69 others 1y ago

actually, maybe the 70 billion param one would be fine 😂

Avatar
feline 1y ago

Build a 3x 3090 machine. Keep us updated 😁