nostr:nprofile1qqsgha3fk023ng8c4quszdayghqwkt6l9d9ga4c3280gnqz3aqqx7ycppamhxue69uhku6n4d4czumt99usxq3zu how desirable is occational hosting? I already host on the free AI Horde sometimes but #KoboldCpp gives priority to regular generations. If I put a machine on running a local AI model thats not even on your platform I can only do so for a little at a time which will make availability fluctuate.

"Yes, please do our users expect it"

Or

"No, there are minimum hosting requirements (to earn rewards)

Reply to this note

Please Login to reply.

Discussion

Yes please do! Currently the marketplace might not be efficient enough to utilize irregular proxies but in future you will be able to set a low price and traffic will balance even if you have irregular uptime

What price do you recommend for 30B at 16K context?

I'm hosting from a machine that will sometimes be unavailable.

Let's all just give it a go!

The chat messages include full conversation, so context can move between providers and I think they'll end up load balancing the models across providers or something similar to account for unavailability etc.