I have wanted to figure out how to run a local AI model for maximum censorship resistance. What model did you land on? Do you plan on doing any tutorials? Any links or advice would be very much appreciated.
Discussion
Yeah, I plan on using Kobold.cpp for loading the AI, the model I’m using will be dolphin-mixtral (to start off), and possibly using Silly Tavern for the chat interface. I could do some tutorials that are blog based and put them on my website if that would help.