I went and toyed around with AI yesterday evening.

Dude, the tooling has matured hardcore over roughly a year. AnythingLLM and LocalAI is ultra viable and ridiculously fast; InvokeAI is a super neat tool and the backends are amazing.

Nothing like the crappy python interfaces that started it all. Ooba and friends are still around, but there are better UIs now. Absolutely impressed.

I could see myself developing with LocalAI + Spark, for instance. The better LangChain if you will.

Now if RISC-V's V-Extension goes hard, this'll actually be amazing. ^.^

Selfhosted, local AI is something I can trust and have fun with. :3