Nostr Web Client

These models are going to melt my i5 1235u + iris xe laptop

It’s melting mine.

This is too much.

Please Login to reply.

I have no context as to what kind of hardware can run these open models. Do you need a GPU?

Yes

The bigger the model, the stronger the gpu

Size doesn't matter. It's how you use it.

lol

It matters

I tried a 1.5b llama model if my memory wasn't weak, and it gave me a made up answer for updating solus linux

A higher nB model (7 or 8) gave me the correct result

Things doesn't come without a cost