thanks for sharing! on which hardware and software stack do you run the models?
Please Login to reply.
Ryzen 5 12 threads, 64g RAM, GTX 1660 super
Currently a very simple Ollama + open Webui build
A very normie capable stack