SimpleX - Chat introduced an experimental LLM-bot which allows users to interect with AI through chat. It is built upon the yet unstable python framework simpx-py. The bot is making use of the OpenAI python module to stream requests using live messages. Self hosting is currently possible with koboldcpp thanks to its built-in OpenAI API emulation. Be aware that the bot can read all of your messages.

https://github.com/shumvgolove/simpx-py/tree/fixes

https://github.com/simplex-chat/simplex-chat/blob/sh/llm-bot/apps/simplex-llm-bot/bot.py

https://github.com/LostRuins/koboldcpp

#SimpleX #privacy