Right now, I’m running Mistral through ollama. Takes a while to get responses back. My machine is a 6-core Intel-based 2018 era Alienware gaming PC with 16GB RAM.
Discussion
I’ve got 64GB RAM arriving today. I don’t expect it to help with performance, but it should enable me to run bigger models.
