If you have 160 GB of VRAM, yes!

Reply to this note

Please Login to reply.

Discussion

That sounds doable or?

Certainly for some folks. Definitely need some solid hardware. Running locally is super easy with ollama and OpenWebUI