Replying to Avatar TKay

It’s melting mine.

This is too much.
Avatar
Rich Nost 5mo ago

I have no context as to what kind of hardware can run these open models. Do you need a GPU?

Reply to this note

Please Login to reply.

Discussion

Avatar
أنس القطونجي 5mo ago

Yes

The bigger the model, the stronger the gpu

Avatar
Alex Gleason 5mo ago

Size doesn't matter. It's how you use it.

Avatar
TKay 5mo ago

lol

Avatar
أنس القطونجي 5mo ago

It matters

I tried a 1.5b llama model if my memory wasn't weak, and it gave me a made up answer for updating solus linux

A higher nB model (7 or 8) gave me the correct result

Things doesn't come without a cost