Replying to Avatar calle

Free all the LLMs! ✊

dolphin-mixtral – An uncensored, fine-tuned model based on the Mixtral mixture of experts model that excels at coding tasks.

https://ollama.ai/library/dolphin-mixtral

Avatar
pleblee 1y ago

Are you offloading this to your gpu? I've always suck to GPTQ models because CPU quantuzations can never be as good.

Reply to this note

Please Login to reply.

Discussion

Avatar
calle 1y ago

Yeah, MacBook pro works great