Honestly I tried it but with ollama, but it was glitchy. Please consider adding hfAPI as an option too to be truly open source and optimize it to work light with ollama.