Replying to Avatar jb55

used open-webui for the first time with llama.cpp ROCM server + AMD RX 5700 + llama-3 8B instruct. very slick local ai workflow. speed is very fast. slightly dumber but its not too bad.
Avatar
jack 1y ago

what's the genuine use of these smaller LLMs?

I've seen some which people have ran on Mac minis at home, but they don't seem that smart - as you said

Reply to this note

Please Login to reply.

Discussion

No replies yet.