I just have ollama over wireguard, and I use litellm to interact with local or remote models programmatically. I use prefect to visualize the workflows. But otherwise its all just python code