Replying to Avatar Justin Moon

Have you found any benefits to self-hosting the model other than privacy?
Avatar
jb55 10mo ago

its a prerequisite for a lot of things I want to do, mainly around private RAG (emails, etc). I would obviously use a frontier model if I could, but I don't have the GPU power for that.

Reply to this note

Please Login to reply.

Discussion

Avatar
guy 10mo ago

I want to see screenpipe integration 😂 I would definitely only run something like that locally.... And still feel paranoid about it.

Avatar
Justin Moon 10mo ago

Ok yea that sounds really enticing. Look forward to hearing about your progress …