Ollama for the runner, multiple models like gemma3 , qwen2.5, mistral for different tasks, and openwebui for chatgpt like UI, there's a lot more you can do but this does like 95% of the job.