How does the AI manage the session context. Does it reset in every message as a new session or does it know the short past?
Discussion
Depends how much history you hand over. In principle, most models can handle the conversation history as context (depending on the length they can deal with). You either can forward the history or you do one request at a time. depends on what you want
Well, as a user of AI, I constantly need to start fresh. So, there must be some button somewhere to reset the context.
I often tell the conversation to give me a prompt that will allow me to start fresh based on “where we are and leave behind the conversation portions that have been abandoned.” Sometimes this works. 🤞
I use simple commands to my bot like
/new (fresh session)
/session (list sessions)
Etc.
I think we need some kind of meta text that clients could render as a menu bar, for talking to bots