Replying to Avatar nikola

There is already a closed loop between Stackoverflow and AI and both are dying slowly. Stackoverflow from lack of users and good moderation and AI (specialized in programming help) due to all the inbreeding data it gets fed. Pool of answers (data to feed the AI) made by humans is still a necessity and will be for some time methinks.
Avatar
fiatjaf 2y ago

What is the solution?

Reply to this note

Please Login to reply.

Discussion

Avatar
nikola 2y ago

I don't know. The only thing I do know is that *all* current LLMs have to get pruned and corrected from time to time since they get fed and then produce subpar results.

https://arxiv.org/pdf/2307.09009.pdf

Garbage in, garbage out. ¯\_(ツ)_/¯

If I had to speculate than we have to wait for LLMs who *can produce and deduce* new information instead of garble what it's fed and provide seemingly intelligent responses. Those LLMs would be AGI at that point though.