mistral-7b-instruct feels like chatgpt, its running fast on my macbook, and its only a 5GB model. Wow!
https://cdn.jb55.com/s/9d74cabac4f4c15f.txt
Have you tried llava? I’m amazed by how it runs on my 16GB Mac under ollama.ai.
https://llava-vl.github.io/
Please Login to reply.
Not yet!