Hi mate. I’m running 14B on a MacBook Pro M3 Max. It’s pretty fast but I should probably run the 32b.
I’m also running Llama 70B, it works but it’s a bit slow.
Discussion
Yeah, I think my setup should cope with 32b, maybe 70b. Will give them a try.
Hi mate. I’m running 14B on a MacBook Pro M3 Max. It’s pretty fast but I should probably run the 32b.
I’m also running Llama 70B, it works but it’s a bit slow.
Yeah, I think my setup should cope with 32b, maybe 70b. Will give them a try.