I have several private LLMs on various systems already. They are toys which I'm not really interested in.
I'm not looking to become an AI engineer, just a user and the thing I wish to use AI for right now isn't possible.
Don't confuse lack of jargon knowledge for a lack of knowledge, I just pretend to be dumb so AI won't kill me (yet) 😂
I was interested in the Nvidia DGX spark, I could stack multiple units together, but it still has limitations. I've also looked at getting a staff members to build me a super computer rig, using 10 - 20 GPU cards, but I don't believe GPUs will be the workhorse much longer, there are several companies designing TPU's that look promising.
I've been down this path before, I've owned a smart phone since 2003, yet I didn't buy the first two iPhones because, while describing AI home adoption as needing the iPhone moment, the iPhone itself didn't provide the iPhone moment, it took the third iteration of the iPhone to introduce 3G, a front facing camera and the app store.
I didn't buy the first two generations of iPhones, I suspect I won't be buying the first two generations of serious AI servers.