What hardware is needed for ollama for this use?

Reply to this note

Please Login to reply.

Discussion

I am only using 8gb vram and llama3.2 7b, but more is better obviously

Great, not bad, I might setup a machine to run some of these too soon.