I don't know. The only thing I do know is that *all* current LLMs have to get pruned and corrected from time to time since they get fed and then produce subpar results.

https://arxiv.org/pdf/2307.09009.pdf

Garbage in, garbage out. ¯\_(ツ)_/¯

If I had to speculate than we have to wait for LLMs who *can produce and deduce* new information instead of garble what it's fed and provide seemingly intelligent responses. Those LLMs would be AGI at that point though.