Replying to Avatar Vitor Pamplona

True, but it's not about using the 10T link all the time. It's about using all of it for a few seconds.

It's the same issue with SSD speeds on mobile. They aren't even discussed in the spec lists and are the main factor of app start up slowdowns.

For the ram, I want to do local AI with mega models out there. So, the phone has to load 400GB to memory, run and dump it out VERY quickly (<50ms).
Avatar
ynniv 1y ago

Ten times the money might get you twice the performance. But, a server can get you ten times the performance for about the same price. This is what makes Ollama so compelling.

It's nice to see a 4B model on my phone, but on a PC in the closet I can run a 70B. These are the trade offs you make to live in the future (meaning, ahead of the curve).

Reply to this note

Please Login to reply.

Discussion

No replies yet.