I tried this open-source platform to self-host LLMs, and it’s faster than I expected

https://www.xda-developers.com/open-source-platform-to-self-host-llms-faster-than-expected/