Ten times the money might get you twice the performance. But, a server can get you ten times the performance for about the same price. This is what makes Ollama so compelling.

It's nice to see a 4B model on my phone, but on a PC in the closet I can run a 70B. These are the trade offs you make to live in the future (meaning, ahead of the curve).

Reply to this note

Please Login to reply.

Discussion

No replies yet.