Also, there seems to be an issue with both goose and MKStacks (Is Stacks based on Goose?) whereby it doesn't properly prompt cache when using our API key.
We would love to solve this issue because it seems to be costing users over double vs using openrouter.
It is on our to-do list to look into this but perhaps you nostr:nprofile1qy88wumn8ghj7mn0wvhxcmmv9uq37amnwvaz7tmwdaehgu3dwfjkccte9ejx2un9ddex7umn9ekk2tcqyqlhwrt96wnkf2w9edgr4cfruchvwkv26q6asdhz4qg08pm6w3djg3c8m4j can also look into why this might be happening.
Could you elaborate a bit on "prompt cache"?
Please Login to reply.
Prompt caching is something that can be done with anthropic models:
https://www.anthropic.com/news/prompt-caching
mhmmm, this sounds cool!
Thanks.