JAN.AI is another great client. Recently been testing this as well. Can load own LLM's from huggingface to use here just like GPT4ALL