I couldn't agree more. Hallucinations is truly the biggest problem with these models—you can never be sure whether the response they provide is correct or completely made up.
Even for coding, I prefer snippets more than AI, especially when working on serious app.
And with the current architecture, it really seems like things will keep getting more and more centralized.
I think some sort of breakthrough is required.