Replying to Avatar Bill Monroe

I'm curious if the prompt caching was working properly when you were using MKStacks. I had another user report that it wasn't. If that's the case, you would have been paying about double what it should have been.

If you DM me your credit id I can look it up and see if the prompt caching was happening or not.

But for some reason Goose and this new Stacks tool have trouble prompt caching. I'm not sure if it is PPQ's fault or the tools' fault, but I've been investigating.

nostr:nprofile1qyg8wumn8ghj7mn0wd68ytnddakj7qgkwaehxw309ahx7um5wfjkc6t5v4ejummjvuhsqgzqh8y9lll2lsw2m7xrpf89ezrxplmwf9c6phrj84dtva94ucd52yr8jvw7 also built a tool which intercepts the prompts from these tools for deeper examination. It may play a role in diagnosing the issue.

https://github.com/gzuuus/transparent-oai-api

Reply to this note

Please Login to reply.

Discussion

No replies yet.