Replying to Avatar Diacone Frost

I'll go with ollama + open webui.

primariliy I want to provide restricted models for my kids so it will help them with education but disallow them to cheat.

then i want some good model for coding, i need to find some which will fit the best.

I plan to setup my mcps to help me with clojure, java and golang development.

I hope I can extend the models with my personal notes I've been compiling for ober a decade.
Avatar
Ave Delphina 5mo ago

Look, I don’t say I hate you, but I need to fix my car and not upgrade RAM on my homeserver…

Reply to this note

Please Login to reply.

Discussion

Avatar
Diacone Frost 5mo ago

ram is cheap, vram is what's really expensive

Avatar
Ave Delphina 5mo ago

Yes, it is. But just out of curiosity, I have ordered RAM upgrade for my homeserver to see if it’s usable. And because I guess it is, the next step would be dedicated hardware and there we go…

Avatar
Diacone Frost 5mo ago

I don't have any usable graphic card and CPU is basically useless for anything near serious.

If you want to run bigger models I think 23g of VRAM is a must (rtx3090, 4090, 5090).

Oldest one sucks already. I'm thinking to pair 4090 (if I can get it) with 5070ti for parallel computing (l've seen something similar working).

That's ~$5.5k (whole rig witout periferies)

Avatar
Ave Delphina 5mo ago

Yes, that’s what I imagined. But let’s see.