Rewrote my bot to read values from a config file and the result has been great so far. Here is how it looks for me:

[Sampler]

temperature = 0.62

max_length = 14500

max_context_length = 32768

top_p = 0.90

min_p = 0.07

top_k = 25

rep_pen = 1.04

rep_pen_range = 330

rep_pen_slope = 0.6

enable_thinking = False

stop_sequence = \nuser, \nmodel,

[Settings]

host = http://localhost:5001

display_name=UEAIB

full_name=unofficial experimental AI bot

description=I'm not responsible for alien invasions

welcome_message=This is a test chatbot running on my shitbox. I can see all of your queries.\nUse /reset command to start a new session. Session will automatically reset after 5 minutes without messages.\nDo NOT share private or security-sensitive information!\ntemporary contact: https://smp5.simplex.im/a#-m-PgMG-4tFTrzkwF3BFf5x-rDHbaW7oeFOWNrhLtFs

auto_accept_message=

command_prefix=/

image = data:image/jpg;base64,/9j/4AAQSkZJRgABAQAAAQABAA(long base64 image)

[Adapter]

system_start: <|im_start|>system\n

system_end: <|im_end|>\n

user_start: <|im_start|>user\n

user_end: <|im_end|>\n

assistant_start: <|im_start|>assistant\n

assistant_end: <|im_end|>\n

I'm too lazy to write anything else, just beleave me that this is exciting.

Link:

https://smp6.simplex.im/a#cSOiK--O58xQht8Nz5B0-qygNSl-l3IAVN6rJ6qTGeI

#simplex

#SimpleX

#bot

#messenger

#privacy

#nost

#introductions

Profile picture by nostr:nprofile1qqst8av970sr3uwueha094apgjdyrps9cwfv6va60ufhhj3yssh4lyqpr4mhxue69uhkummnw3ezucnfw33k76twv4ezuum0vd5kzmp0qythwumn8ghj7anfw3hhytnwdaehgu339e3k7mf0qyvhwumn8ghj7un9d3shjtnddakk7um5wgh8q6twdvhs6fr8wp