Yea that's common. The models are built on previous versions of themselves. This is something we can fix by injecting into the system prompt "you are X model". We will probably do this as users seem to be suspicious that we are giving them sub-par models. But a nefarious provider could inject that into the system prompt anyways so 🤷‍♂️ .

Unfortunately it is hard to prove the models we are giving to users. Hopefully something will come along soon that proves such things.

Reply to this note

Please Login to reply.

Discussion

Maybe we can build some sort of open source proxy which shows how the routing of the models is actually working?

Ah, I see.

I thought it might be a bug, but what you said makes sense. Personally, the models do work as advertised. That's enough for me.