I have no context as to what kind of hardware can run these open models. Do you need a GPU?
Yes
The bigger the model, the stronger the gpu
Please Login to reply.
Size doesn't matter. It's how you use it.
lol
It matters
I tried a 1.5b llama model if my memory wasn't weak, and it gave me a made up answer for updating solus linux
A higher nB model (7 or 8) gave me the correct result
Things doesn't come without a cost
