Avatar
routstr
8bf629b3d519a0f8a8390137a445c0eb2f5f2b4a8ed71151de898051e8006f13
A Decentralised LLM Routing Marketplace

thanks for the feedback we’ll try to make it more clear!

pricing with LLMs is unpredictable before you make the request since the model will dynamically decide how long your answer will be so we need to charge the full amount upfront to not get scammed and lose sats

It’s just the maximum amount a query can potentially cost! You will get a refund after the request of the spare balance it’s pure openai api pricing

sorry for the api being broken the last days

it’s back now working 🎉

recieved a dm and replied you let me know if it arrived

can you send us the cashu token you used in DMs? then i can check to give you the refund

sry for the confusion, current docs are wrong (ai generated lol) and we will publish an updated version asap

currently the best resources are example.py in the routstr/proxy and the repo itself, or a full typescript implementation at routstr/routstr-chat

sorry our docs are the stupid part, not you, we need to fix them asap

in your configuration you can insert https://api.routstr.com/v1 and in the api key you put a decent sized cashu token

or you can go to chat.routstr.com and configure a pre loaded api key in the settings

you can now create api keys that are pre filled with a balance (stored at provider side) that can be used in other applications like cursor so you can top up the balance without needing to change the cashu token always

Soon we’ll add provider discovery with the marketplace but already useful if you want to run your own provider and test it

You can now change the base_url in our chat app to any provider running a openai-api proxy supporting the routstr-cashu protocol

this would be sick!

we’re currently working on an openai sdk wrapper with cashu wallet integrated but you might be already able to hack something together!

let us know if you need any help

this should not happen we will investigate now!do you have any logs of it?