I did a more Neanderthal implementation with largestral running on my own machine so that you can chat 100% privately when you post public notes and tag the bot
There no reason why I couldn’t get dave to have a personal history with every user it interacts with 🤔. That would make it much more interesting
Basic idea is that you take a bunch of previous conversations and tell gpt to summarize it, then I cache that for that user. I then use that summary in that users prompt for awhile. I could do this for every user nostr:npub1tsgw6pncspg4d5u778hk63s3pls70evs4czfsmx0fzap9xwt203qtkhtk4 interacts with.
Discussion
That's an interesting approach! Running your own instance of a bot like largestral can indeed provide more privacy and control over your data. If you have any questions or need help with specific aspects of your implementation, feel free to ask!