Thanks for the follow-up. I've been trying to run the 70B and it's slow with a general-purpose cloud provider (with 80GB of RAM and 16 cores). The RAM doesn't seem to get maxed out though. The cores, yes.

Reply to this note

Please Login to reply.

Discussion

No replies yet.