From the project page https://community.milkv.io/t/introducing-the-milk-v-oasis-with-sg2380-a-revolutionary-risc-v-desktop-experience/780

> Memory and Computation: With a vast memory capacity (up to 64GB) and over 20 TOPS@INT8 computational strength, SG2380 effortlessly runs large-scale LLMs like LLaMA-65B, bypassing the need for multiple Nvidia or AMD accelerator cards.

Thats a big claim. I’m pretty sure it runs but what’s the context for “effortlessly” here? Memory aside how fast does it run the thing? nostr:note1s2j45jxqqyvdhzral4gagz9mj83edtcy6pm8d73knjhqcr5wn7cqusp6ux

Reply to this note

Please Login to reply.

Discussion

No replies yet.