I hear you. My paranoia prevents me from having any persistent data on any of my client/workstation devices. Ollama + opewnwebui is the easiest way to do this IMO. You just get a really nice webui similar to chatgpt.com with way more features. It also ships with an authenticated OpenAI api you can use from curl if you want or other CLI clients.