ollama + openweb-ui + tailscale and you're basically done. openweb-ui supports Internet searches but it's kinda meh. (I only tried Brave.) It also allows for further training based on local files.

Models and ollama don't phone home, nothing ever leaves your computer.

Reply to this note

Please Login to reply.

Discussion

openweb-ui even ships a docker compose file that comes with ollama already. If you're on Nvidia/Apple Silicone it'll likely work ootb, with AMD/Intel you might have to do minor changes.