Nostr Web Client

thats why u need to run llms locally

1. to know that nobody can be in between you and the model

2. to know that you are not provided lies

ChatGPT and Gemini are the worst things that have happened to privacy. You need to self-host LLMs if you care about your privacy and if your system can handle it.

Holesail makes locally running LLM accessible from anywhere on any device!

nostr:note169s0wet48nudvkkcdwscct9pf7fzggwxhkp5yavje2s6g3s756uqtkqgz8

Reply to this note

Please Login to reply.

Discussion

PolymathicPedagogue 1y ago

I just started looking into Holesail, so forgive me if this is a total noob question.

Would Holesail allow a university or other institution to host their own LLM and then provide access to all students and academics? Or is it more for one-to-one access?

supersu 1y ago

It is for both and yes what you are talking about is possible.

PolymathicPedagogue 1y ago

Thanks for the speedy reply! That sounds brilliant. Are there any specific, self-hosted LLMs you'd recommend for such a use case?

supersu 1y ago

I like Mixtral 8b7x something with 32k context limit.