Tried to run Llama llama3.1:405b

Error: model requires more system memory (207.7 GiB) than is available (39.0 GiB)

Hmmmm, maybe I'm not prepared for this.

Reply to this note

Please Login to reply.

Discussion

Two AMD Instinct MI250 is all you need…