Replying to Avatar armstrys

If you have 160 GB of VRAM, yes!
Avatar
𝕞𝕪𝕡𝕒𝕥𝕙𝕥𝕠𝕗𝕚𝕣𝕖 11mo ago

That sounds doable or?

Reply to this note

Please Login to reply.

Discussion

Avatar
armstrys 11mo ago

Certainly for some folks. Definitely need some solid hardware. Running locally is super easy with ollama and OpenWebUI