Checkout Ollama. Not the best performance but it's rather easy to use and will work even if you don't have much VRAM/GPU compute.

Reply to this note

Please Login to reply.

Discussion

No replies yet.