Nostr Web Client

I've ran the numbers running my local LLM with this and its really hard to beat with a custom built PC

Just upgrade hardware in 24 mo. and you'll stay at a reasonable "bleeding edge" of local LLM bare metal

It's quite difficult to beat $799 for such a dominant mini PC (24 GB Ram)

Please Login to reply.

I yolo bought a 64gb model, going to use it as my backup bitcoin node + large model inference tasks

Brilliant🚀

M4 Pro is still a great deal if you want to swing the ~2M sats

Just realized you can get an m4 macbook with 128gb of unified ram. That would be wild for large model inference. A little more pricey but… hmm

70B LLM's would be easy to run...👀

🤔

Yeah you get 8tokens a second though

True

Need to max out the cores. Idk if a 14-core CPU is enough

A single core CPU is enough tbh

Surely there's more you could be doing to increase the attack surface

Minisforum EM780 is cheaper, 32GB RAM, and actually mini by modern standards (small enough to fit in a pocket)

Care to share link?

Looks like the official store is one of the only places that's not saying it's sold out right now