At routstr were building the first marketplace to buy and sell LLM APIs using cashu tokens.
Using our proxy you can monetize any OpenAI API compatible LLM server on a per token basis at msat precision (e.g. your local hosted LlamaCPP server)
As User you can just put a cashu note into the api-key field of your llm application and as long as the balance lasts, you can leave the same note.
We dont have everything build out yet and soon we’re getting the marketplace onto nostr so people can list their own nodes.
To then ensure trust and quality we are working on a separate evaluation system so you know which nodes provide a good service.
