Running a local LLM isn't hard, running a big one can get expensive in hardware though.

Reply to this note

Please Login to reply.

Discussion

Any resources where I can learn how to run and install my own local trainable LLM?

Training is a whole other ball game. But just installing a small pre-packaged LLM can be just a docker container.

https://github.com/getumbrel/llama-gpt

Thank you ⚡💜