Global Feed Post Login
Replying to Avatar ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ

i only know that the gpt-oss model, 20b weighs in about 12gb, and is about the biggest i can run on a 16gb GPU.

i can also tell you that you need twice as much, at least, to do programming level reasoning. the cloud services with gpt5 and all those, they are running on 128gb+ devices. these are coming to the domestic market end of this year. actually training them, though, it's just like bitcoin mining. the more, the sooner the reward.

Avatar
YODL 2mo ago

That's helpful to get a sense. Thanks!

Need to take a day sometime soon, probably with gpt, and get a better understanding of the landscape. It all feels like it's passing me by while my inner boomer grows ever more annoyed.

Reply to this note

Please Login to reply.

Discussion

No replies yet.