I just started looking into Holesail, so forgive me if this is a total noob question.
Would Holesail allow a university or other institution to host their own LLM and then provide access to all students and academics? Or is it more for one-to-one access?
It is for both and yes what you are talking about is possible.
Please Login to reply.
Thanks for the speedy reply! That sounds brilliant. Are there any specific, self-hosted LLMs you'd recommend for such a use case?
I like Mixtral 8b7x something with 32k context limit.