70B LLM's would be easy to run...👀
🤔
Yeah you get 8tokens a second though
Please Login to reply.
True
Need to max out the cores. Idk if a 14-core CPU is enough
A single core CPU is enough tbh
