Self hosted inference of GTFO
Discussion
yes that is supported, but the local models just aren't as good right now. it seems they are rapidly improving with new consumer hardware though.
in the meantime, https://jb55.com/lmzap and not including any identifiable information in the prompt will help a lot.