Wait. Are you saying this one RISC-V chip with a crapton of CPU perf as it is, can outperform my 4090 in terms of LLM capabilities?! Okay, THAT is nuts (if true). o.o

---

Memory and Computation: With a vast memory capacity (up to 64GB) and over 20 TOPS@INT8 computational strength, SG2380 effortlessly runs large-scale LLMs like LLaMA-65B, bypassing the need for multiple Nvidia or AMD accelerator cards.

---

Via: https://community.milkv.io/t/introducing-the-milk-v-oasis-with-sg2380-a-revolutionary-risc-v-desktop-experience/780

Reply to this note

Please Login to reply.

Discussion

No replies yet.