it’s just the openai api specification no need to connect to any openai servers

you can start the proxy using this command:

docker run -p 8080:8080 ghcr.io/routstr/proxy

check the .env.example in the github.com/routstr/proxy repo for all the configuration options

you need to set it up so it proxies to your local ollama server

you only need an openai api key if you want to proxy requests to their servers