you guys think i can run an ai model by myself locally? i rly need an AI assistant
Discussion
I believe in you
like, is it worth it u think? ill have to train it dont i?..
i want to use it to help structuring info better and more efficient
1) What kind of hardware do you have?
2) training is super cumbersome, so even if you have hardware to run, its a completely different game to train
3) can you code?
1) What? (i dont, my start9 is at max unfortunately)
2) ok i skip that then
3) not without a v detailed stepbystep guide for dummies, but no time for that actually
how bad is the verdict
Does your laptop/desktop have a GPU? Otherwise local seems out the realm of possibility.
I like using Perplexity.ai for my writing/ideas. labs.perplexity.ai seems less likely to collect data and Brave comes with a free LLM as well both of them are pretty fast.
tqtqtq that's great tips
idk if my laptop has gpu lol what is THAT 😂
CPU what your computer uses to execute actions. Does them sequentially, one after another.
GPU does actions in parallel (rendering pixels on your screen at the same time, changing at the same time
Like an LLM? Or something else?
There is LlamaGPT on Umbrel.
hmm i have start9 but i think there's not enough space left..
and idk i think llm yes.. that's just text based right?
Maybe this is what your looking for? It's an app that let you download LLM models and use them like ChatGPT (also works with chatgpt if you want).
GPT4ALL runs mixtral locally 👍
