What framework are you using to run the models?

I just started testing privateGPT.

The possibility to feed local documents is interesting, but it seems they are managed as a separate knowledge base.