Nostr Web Client

Well... if the server has it queued up in memory, and you have a 10Tbit link throughout, and there's nothing else using bandwidth, etc etc.

In practice my 2.5 Gbit fiber hardwired to a 10 Gbit router, hardwired to a 1 Gbit PC with plenty of CPU and memory rarely pulls 100 MB/s. That said, on the rare occasion it does (usually from Microsoft or Steam), I wish that I had sorted out a better link from the router to the PC.

And even WiFi 6's relatively high latency still makes for playable VR on a Quest 2. We always have more than we think, but less than we want.

Vitor Pamplona 1y ago

True, but it's not about using the 10T link all the time. It's about using all of it for a few seconds.

It's the same issue with SSD speeds on mobile. They aren't even discussed in the spec lists and are the main factor of app start up slowdowns.

For the ram, I want to do local AI with mega models out there. So, the phone has to load 400GB to memory, run and dump it out VERY quickly (<50ms).

Reply to this note

Please Login to reply.

Discussion

ynniv 1y ago

Ten times the money might get you twice the performance. But, a server can get you ten times the performance for about the same price. This is what makes Ollama so compelling.

It's nice to see a 4B model on my phone, but on a PC in the closet I can run a 70B. These are the trade offs you make to live in the future (meaning, ahead of the curve).