Wow this looks really cool. Didn’t know you can run this locally 😳
Questions. Does it censor? Do you have to jailbreak it to get it to say interesting stuff? Whats the generation speed like? Whats your hw specs like if you don’t mind sharing.
Discussion
No censorship. No need to jailbreak. There's even already forks you can load with nsfw training data.
For the main project look up llama.ccp. It uses leaked data from Facebook's ChatGPT competitor.
For the fork that runs Hugging Face data (including nsfw) look up bloomz.ccp.
Give it a month and this will be a bigger game changer than ChatGPT.
