Great question, thanks. Does anyone have experience setting up llms on like a small cluster of computers? I have like a couple old dells and was wondering if one could use them to run a local LLM
#asknostr
Discussion
well i am using ollama on apple mac and open-webui in my hp elite desk. it doing good and fast as well. leveraging ram for browser interface.