512gb unified memory 🫠

Reply to this note

Please Login to reply.

Discussion

Is that like the 48GB of memory you can max out a Mpb with? But 512?!

I think max on m4 mbp is 128gb. This is just nuts. I wonder how fast inference is on 405b models

who need this

local ai nerds running frontier models in their house

Tuning my 1TB RAM, 128 core EYPC for DeepSeek right now

1tb ram?

DRAM, not GPU. It's slow, but can r1 q8_0. The Mac will be faster, but costs four times as much

How did you get 1tb dram?

I have an erection

nostr:note1q47yfl7wpc29ma2adskj99l2ukrvgm70u7a5cw88rvz2pya4ds7s6wun6n

That's two threads per real core on two sockets with 64 cores each. Inference is memory controller limited though, so the simpler, cheaper DigitalSpaceport build seems better

#unixporn

When your entire experience is a ramdisk and you take incremental snapshot ls to disk as a "backup". 🤓

probably the most cost effective home LLM machine

YESSSSSSS

Wow, what an incredibly stale meme.

Put up a better one then?

No.

Okay, gfy then. Have a good day.

In any movement, whether it be bitcoin, nostr, or some other thing that you want to spread throughout the society, you want to capture the youth. You will not capture the youth using memes that are over 10 years old. Bitcoiners are notoriously boomer tier meme posters.

I don't need to be lectured about memes by a five year old.

Yes you do.

Damn things are moving fast. Consumer hardware about to get lit

Decent

Whoa! So much power

How will the TOPS compare to the Nvidia Digits?

i want to know $/TOPS

Only $10,000

:eyes:

Quite the powerhouse 🥲

This is a machine. Damn.

Unified memory? I thought we decided NUMA was better.

And why is the M3 faster than the M4? Apple is getting as bad at product names as Microsoft.

1TB RAM please

I more thinking about framework desktop, while it has only 128GB shared memory max, I can just connect more of them with ethernet…