Thanks for the follow-up. I've been trying to run the 70B and it's slow with a general-purpose cloud provider (with 80GB of RAM and 16 cores). The RAM doesn't seem to get maxed out though. The cores, yes.
Please Login to reply.
No replies yet.