Thanks for pointing me toward ollama i have the 64gb to run a larger model on desktop, gonna try out this weekend. Nice model browser they have.

also been playing with mlc chat on my phone… haven’t pushed that past 7b either.