Nostr Web Client

Yea the speed is nuts but I have a feeling that is because it is not seeing the demand yet. It is some monster provider with huge infra (openAI perhaps) testing out their model before release.

Leo Wandersleb 5mo ago

I see "openAI perhaps" but on your website you attribute it clearly to openAI at https://api.ppq.ai/models

How do you not know? What would be the api endpoint to try it out without going through ppq? I'm having size issues. Some 403819 bytes queries run into issues with this and other models that should support a million tokens.

Reply to this note

Please Login to reply.

Discussion

PayPerQ 5mo ago

I think we get the "owned_by" from openrouter in this case as we are pulling the model from there.

PayPerQ 5mo ago

I'm curious if a query that fails via us will work with openrouter. If so, that clearly points to some problem we have with how we are routing things.

Leo Wandersleb 5mo ago

I would need an account with openrouter i suppose but as horizon is so stealthy, maybe I can use it more directly without account?