Global Feed Post Login
Replying to Avatar PayPerQ

Also, there seems to be an issue with both goose and MKStacks (Is Stacks based on Goose?) whereby it doesn't properly prompt cache when using our API key.

We would love to solve this issue because it seems to be costing users over double vs using openrouter.

It is on our to-do list to look into this but perhaps you nostr:nprofile1qy88wumn8ghj7mn0wvhxcmmv9uq37amnwvaz7tmwdaehgu3dwfjkccte9ejx2un9ddex7umn9ekk2tcqyqlhwrt96wnkf2w9edgr4cfruchvwkv26q6asdhz4qg08pm6w3djg3c8m4j can also look into why this might be happening.

Avatar
Crusty 👨‍💻 6mo ago 💬 3

Could you elaborate a bit on "prompt cache"?

Reply to this note

Please Login to reply.

Discussion

Avatar
PayPerQ 6mo ago

Prompt caching is something that can be done with anthropic models:

https://www.anthropic.com/news/prompt-caching

Avatar
Crusty 👨‍💻 6mo ago

mhmmm, this sounds cool!

Thread collapsed
Avatar
Derek Ross 6mo ago

Thanks.

Thread collapsed
Thread collapsed