Global Feed Post Login
Replying to Avatar rewolf

awesome thanks! I had a similar idea to this, a marketplace for models and users. Brilliant. Glad someone else made it first haha.

All requests go through the proxy right? And the proxy communicates with the OpenAI-API-compatible model endpoint?

So, correct me if I'm wrong:

1) if the model endpoint is on a different network/host, the port will need to be exposed

2) the proxy address is the address that we advertise on nostr and the one that clients will connect to

3) the proxy therefore needs to also expose ports on the network

4) If you're running this at home, you'd need to port-forward at the router AND your public IP would be exposed, unless using Tor hidden services.

Avatar
redshift 5mo ago

You’re right on all of that.

And of course you don’t need port forwarding if you’re hosting via Tor.

Reply to this note

Please Login to reply.

Discussion

No replies yet.